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ASYMPTOTIC LEARNING IN PSYCHOPHYSICAL THEORIES! 
By R. DUNCAN LUCE 


University of Pennsylvania 


The major types of models that have been proposed to account for the 
psychophysical data that are obtained when the stimulus differences are small are 
described briefly. Because it is clear that contingency variables, such as presenta- 
tion schedules and payoffs, as well as the physical stimuli affect the response 
probabilities, recent models have included a trial dependent decision mechanism 
in addition to the (usually) static sensory one. Such models all appear to be special 
cases of two very general, but mathematically distinct, families of models, which are 
formulated in eqns. 1 and 5. Hypotheses about how the subject selects the 
response-bias parameters of the decision process are examined. The assumption 
that they are chosen so as to maximize the expected payoff leads to incorrect 
predictions for special cases of both families. The alternative hypothesis studied 
is that the bias parameters are altered from trial to trial on the basis of information 
feedback according to one or another stochastic learning model. Primary attention 
is paid to the asymptotic expected values predicted for these parameters. Several 
such learning processes are described, their relations to static psychophysical 
models outlined, and their ability to explain data discussed. 


I, INTRODUCTION 

Modern psychophysicists divide into two camps, the one concerned with 
people’s responses to small stimulus perturbations and the other with responses 
to large perturbations. It is doubtful if anyone believes the present cleavage in 
method and theory to be a fundamental scientific distinction, but it is nevertheless 
real now. I shall be concerned here with the psychophysics of small differences. 
Included is the research on thresholds and, more generally, on the detection of 
stimuli that are difficult to detect, on the recognition of one of several possible 
stimuli, and on the discriminability of stimuli. The methods used are well 
known and in many cases classical: constant stimuli, single stimuli, pair com- 
parisons, yes-no and forced-choice techniques, and so on. The methods for 
studying large perturbations are the (superficially) direct scaling techniques 
applicable to the whole sensory continuum, e.g., the methods of bisection, 
fractionation, magnitude estimation, category scaling, etc. 

Perhaps the neatest distinction between the methods of the two camps of 
psychophysicists rests upon the fact that in studying small differences one can 
sensibly class responses as correct and incorrect in terms of physical properties 
of the stimuli, whereas this cannot be done with the methods used in studying 
large differences. ‘This means that information feedback and payoffs can be, and 
often are, used in experiments of the first type but not in those of the second 

1 This paper was presented at the International Congress of Scientific Psychology, Washington, 
D.C., August 1963. Its preparation was supported in part by National Science Foundation Grant 
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type. For a more detailed discussion of these matters, see the chapters on 
psychophysics in Luce, Bush, and Galanter (1963). 

An important conceptual revolution in the study of responses to small 
differences occurred during the past decade, and it is still affecting the collection, 
analysis, and theoretical interpretation of data. At the risk of repeating the 
familiar, let me be explicit about this development since the material covered in 
this paper is one of its current phases. Perhaps the revolution is best symbolized 
by the so-called receiver operating characteristic (ROC) curve or, to use the 
term I prefer, the iso-sensitivity curve. In the simplest case of a Yes-No 
experiment, consider the plot of the conditional probability p(Y|s) of a * yes’ 
response, Y, to a stimulus presentation, s, against the conditional probability 
P(Y|x) of a‘ yes’ response on those occasions when no stimulus is presented, 7 
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An iso-sensitivity curve is the locus of points that is generated when certain 
variables are varied but when the stimulus conditions are held fixed. The important 
observation is that such loci appear, in f. 
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With fixed stimulus conditions, any experimental variable that generates an 
iso-sensitivity curve I shall call a contingency variable; examples are the instruc- 
tions to the subject, the presentation probability of the stimulus, the information 
feedback to the subject about the accuracy of his performance, and payoffs. 
Figure 1 gives an example of the data obtained when payoffs are varied. It is 
not certain whether the several contingency variables all generate the same 
iso-sensitivity curve—most of the theories suggest that they do and certainly to 
a first approximation they do. The important conclusion from a large amount 
of data is that these non-sensory variables seriously influence a subject’s perfor- 
mance in experiments designed primarily to study sensory phenomena. 

In what sense can this be called a revolution when, after all, psychophysi- 
cists have long known that contingency variables affect behaviour? Certainly 
these effects are implicitly acknowledged when an experimenter, who is attempt- 
ing to determine a threshold, introduces catch trials and then reprimands the 
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Ficure 2. Psychometric functions (subject 6) reported by Norman (1962) for energy 
increments in a 1000 c.p.s. pure tone with the increment size varying from 0% to 
48%. The payoff matrices and presentation probabilities are shown. Each point 
is estimated from 100 to 500 observations. 


subject for not paying attention when he makes too many false positive responses. 
Such negative experiences usually have the desired effect of reducing the false 
alarms to an ‘ acceptable’ level, and the experimenter is pleased with his skill 
at getting the subject to pay attention to the task; later, when reporting the data, 
he feels content to act as if the only relevant variables in the experiment were the 
physical parameters of the stimuli. ‘Thus, for example, he speaks of the psycho- 
metric function, i.e., the function relating p(Y|s) to a physical measure of s, as 
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if it were unique and quite independent of the reprimand. He seems to believe 
that the unreported, but low, false alarm rate was obtained only at the price of 
increased attention which permitted the unique psychometric function to shine 
through clearly, not beclouded by the subject's daydreaming. Perhaps this 
view is tenable, but one cannot help but be uneasy when one tries to decide just 
how severe to make the reprimand and just how often to administer it in order 
to arrive at the desired function. The difficulty becomes clear when we replace 
occasional reprimands by trial-by-trial payoffs and information feedback. One 
then generates families of psychometric functions by using different payoff 
matrices. Figure 2 shows two psychometric functions obtained from the same 
subject under identical stimulus conditions. The only difference is the payoff 
matrix and the presentation probability used. Which, if either, is the true 
psychometric function? Note that the one more like the usually reported 
psychometric funtions arises from a highly asymmetric payoff matrix. 
Accompanying, and in some cases leading, this acceptance of the ubiquitous- 

ness and significance of contingency variables in psychophysics has been the 
development of new theories that included provision for their effects. In general, 
the theories are of the following form: the conditional probability of response ” 
to stimulus s, (r |s), is some specified function of two classes of parameters, 0n€ 
of which is altered when and only when the stimulus conditions are altered an 
the other of which is altered when the contingency conditions are altered. For 
brevity, I shall refer to the former as stimulus parameters of the model and to the 
latter as response-bias parameters, Thus, an iso-sensitivity curve is generated by 
changes in a response-bias parameter with the stimulus parameters fixed, and 
the curve is unique if and only if there is a single response-bias parameter. A 
particular psychometric function is generated by changes in the stimulus para- 
meters with the response-bias parameters held fixed. i 

; Before turning to the main topic, let me point out that this new point of 
View can have appreciable substantive consequences. For example, several 
studies (Goetz], Ahokas, & Payne, 1950; Hammer, 1951; Yensen, 1959) on taste 
thresholds for sucrose have been interpreted to mean that the threshold is 


II. Static Mopzrs 


„As in most fields, the first psychophysical models to be examined were 
static in character. Although there are quite a number of models that differ in 
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many details, I believe that they all fall into one of two quite general classes. In 
one class, which may be called the internal state models and which includes, for 
example, Thurstone’s law of comparative judgement, signal detectability theory, 
and the low and multi-state threshold models, the stimulus s is assumed to activate 
in a probabilistic fashion an internal state x which in turn leads via some decision 
mechanism to the response r. The overall response probability on trial zm is 
assumed to arise from these two processes acting independently, thus leading to 
the expression 
Pur |5) = [por |) v] s) dv, (1) 
where the integral is just that if there is a continuum of states or it is a sum if 
they are discrete. In the truly static models none of the probabilities depend 
upon the trial number m; however, I have included m explicitly so that 
it will be clear what is assumed to vary when we turn to dynamic models. The 
conditional probability p(«|s) represents the sensory mechanism and pm(r |x) 
the decision mechanism. In specific models assumptions are introduced about 
these probabilities and the free parameters thus introduced are called stimulus 
parameters in the first case and response-bias parameters in the second case. 
In signal detectability theory (Green, 1960; Swets, 1961; Tanner & Swets, 
1954), for example, p(«|s) is assumed to be a normal density function and in a 
two-response situation pm(r |x) is assumed to have the form: 
1 if x> cm, 
Pnlt | x) = (2) 
0 if x «m, 
where cm, which is usually called a cut-point or criterion, is the response-bias 
parameter. If one supposes that the subject chooses cj, so as to maximize his 
expected payoff, then cm is a simple monotonic function of the experimental 
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It is known (Green, 1960) that the assumption that the expected payoff is 
maximized combined with the signal detectability model is not correct in detail. 
However, for many purposes having to do with the sensory aspects of the model, 
the dependence of cm on the payoffs and presentation probabilities does not matter 
and so this overall failure has not caused much concern. 

In the discrete (or threshold) models (Luce, 1963; Norman, 1962, 1963) the 
internal states form a discrete (finite or countably infinite) set. Let x: denote the 
ith state. In some models certain of the parameters f(r|ai) are assumed to be 
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0 or 1 and the rest are free. Again, if we assume that the subject maximizes the 
expected payoff, the overall model is wrong if, as the data suggest, only a few 
states play any significant role. The reason is that the response probabilities are 
linear functions of the response bias parameters and so the maximum occurs with 
some of them equal to 0 and the rest equal to 1; this means that the iso-sensitivity 
curve is confined to a discrete set of points in the plane, in number one less than 
the number of states. Thus, for example, with four states the iso-sensitivity 
‘curve’ would consist of only three points, which is not consistent with the data 
shown in Fig. 1. 

The other class of models, specific examples of which have been discussed 
by a number of authors including Clarke (1957), Luce (1959), Shepard (1957), 
and Shipley (1960, 1961), have been called choice models. ‘These models attempt 
to capture the belief of many psychologists that at least three independent 
processes combine to generate the responses observed in psychophysical 
experiments. First, the presentation of a stimulus results in a subjective 
magnitude that, in general, is non-linearly related to the usual physical measure 
of the intensity of the stimulus. Sucha function is sometimes called a psycho- 
Physical function. Second, the subject exhibits some degree of confusion oF 
generalization either between stimuli or between responses or both, Third, for 
a variety of reasons, a subject may exhibit a bias to 


responses as compared with another response. Let j/(s) denote the subjective 
magnitude of stimulus s, so ib 


Proportional to the amount of 


reasons that are too lengthy to go 


"5 ‘hae. response Probability and these three functions has been postu- 
ated: 


Pr(r|s) - Km tis), r]bs(r), (5) 


1 b 2 re, 
details, see Ch. 5 of Luce, Bush, and Galanter, eae ai get 


Both the internal state and choice models involve unspecified and unobserv- 
able functions. In the former they are p(x|s) and Dw(r|x), and in the latter 
they are J(s), C(t, r), and bn(r). Thus, a test of either model is possible only if 
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additional assumptions are made about the form of the unknown functions so as 
to reduce appreciably the amount of freedom involved, or if experiments are 
designed so that one or more of the functions play no effective role, or if the data 
from a number of closely related experiments are analysed simultaneously. 
Usually, some mixture of all three techniques is used. For example, with a few 
stimuli and responses, # is generally assumed to be the experimenter prescribed 
correspondence between stimuli and responses, ¢ is assumed to satisfy certain 
constraints such as symmetry, i.e., C(t, 7) — t(r, t), the bias b is assumed to be 
constant over responses for certain symmetric experimental designs, and the 
stimulus parameters are assumed to be the same in going from a Yes-No to a 
forced-choice design. 

As with the internal state models, auxiliary assumptions are needed to describe 
how the subject adjusts the bias parameter b with changes in presentation 
probabilities and payoffs. Once again, the evidence suggests that the choice 
model is incorrect when combined with the assumption that the expected payoff 
is maximized. 


III. DECISION-MAKING VIEWED AS LEARNING 


Although the evidence is far from conclusive as to where these psychophysical 
models go wrong, one particularly suspect feature is the assumption that the 
expected payoff (or even expected utility) is maximized. Unfortunately, the 
fact that the axiomatic structure of utility maximization is known is of little help 
in this problem. It is extremely difficult to design experiments adequate to test 
this hypothesis directly within the context of psychophysics. Among the problems, 
not the least is the fact that the behaviour appears to be probabilistic whereas 
the relevant utility models are algebraic. 

The only alternative decision process that has been seriously investigated, 
and that for only a few years, is the assumption that subjects adapt and adjust 
their response biases in the light of their recent experience in the experiment; 
that is, they learn. Surely such an assumption is @ priori reasonable, and any 
psychophysicist is aware that it or some other sort of systematic change occurs 
over trials before the behaviour settles down to the ‘ asymptotic’ values that are 
usually reported. So the question is whether we can effectively couple a 
stochastic learning process with a model for the sensory process in such a way 
that its asymptotic predictions describe behaviour in detection, recognition, and 
discrimination experiments. 

Quite a number of possibilities are available, only a few of which have been 
examined so far. Specifically, we can distinguish three types of sensory processes 
according to whether they postulate no internal state, a discrete set of states, or a 
continuum of them. Second, we have several alternative learning models, 
including the linear operators, certain non-linear commutative operators, and 
the family of Markov chain models that arise from stimulus sampling theory. 
Finally, there is the question of whether the learning applies to the sensory 
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mechanism, the decision mechanism, or both. Soata minimum, there are 33 =27 


possible models. I shall discuss only a few of these, for only a few have been 
worked out. 


simple learning situations in which the same stimulus condition obtains on every 
begun on models for what are usually 
called discrimination experiments in learning. It should be noted that their 
formal analogues in psychophysics are detection and recognition experiments, 
not psychophysical discrimination experiments. The main difference between 


atural ' one that is known to the subje-t, 
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generalization or, what is the same thing, p(7;|s2) decreases directly and prls) 
indirectly. If we suppose s, and sẹ are presented according to a simple random 
schedule with P= Pr(s;) and 1 — P= Pr(ss), then it is not difficult to show (Bush, 
Luce, & Rose, 1963) that the asymptotic expected response probabilities are of 
the form 


and P, (ris) - —@ (8) 


Pí(nlsi)9 mt’ 


1 
14335 


je pieta. 
P jà, 
Since we interpret 7, and 7, as representing stimulus generalization, they are 
the stimulus parameters of the model. The parameter b is interpreted as a 
response bias parameter which depends explicitly upon the presentation 
probability and implicitly upon the instructions and payoffs through the learning 
rate parameters. 

These asymptotic predictions are identical to those given by the static 
choice model mentioned earlier (eqn. 5), and so this linear learning model can 
be treated as a justification of that static model for two stimuli and two responses. 
This learning analysis can be generalized readily to the case of k responses to k 
stimulus presentation and only slightly less readily to the case of 2 responses to 
k stimulus presentations, which is the design usually used in psychophysical 
discrimination experiments, and again close relationships to the choice model 
are found. Certain interesting subtleties arise when the number of responses 
differs from the number of stimulus presentations which suggest, for example, that 
data obtained using the method of constant stimuli are much more complicated 
to analyse than those obtained using pair comparisons (see Bush, Luce, & Rose, 
1963). 

If one looks at the iso-sensitivity curve that is predicted when 7 and 7; are 
held fixed and b is varied from 0 to co, it is seen to bea symmetric curve about 
the diagonal from (0, 1) to (1, 0), as is the curve predicted by the signal detect- 
ability model with equal variances. For human Yes-No detection data this is 
clearly wrong and for two-alternative forced-choice detection data, which do 
appear to be symmetric, it may very well be of the wrong shape. For human 
recognition experiments in which perfectly detectable stimuli are to be identified 
it has not yet been shown to be wrong. For animal experiments it is unclear 
whether or not one can get asymptotic behaviour which lies interior to the unit 
square, If the stimuli are perfectly discriminable, then asymptotically the animals 
usually learn and end up at (0, 1); if the stimuli are not perfectly discriminable 
or if the animals do not learn, they frequently end up at (0, 0) or (1, 1) which 
are position habits or, in present terms, pure response biases. ‘The recent data 
of Hack (1963), although variable and surely not asymptotic, suggest that perhaps 
intermediate behaviour is possible. Much more work on the psychophysics of 
animals is needed before we can be sure what the qualitative facts are. 


where 
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If one sets up the analogous learning process with stimulus generalization 
using the non-linear beta model operators (Luce, 1959) of the following form 


Umii1=Bvm and Um =ß*um, (9) 
where 
Um Um 
71|5))— and 7; |S2)= 
Pw(ri|s) ERU Pw(ri|s;) Titty? 


then Bush (1964) has shown that at asymptote either P_,(r,|s,)=1 or P..(71|52) 
=0 or both provided that the parameters are chosen to produce changes parallel- 
ing those of the above linear model. Such a model is clearly wrong for human 
data, but perhaps it may describe how animals perform. 


V. Two-Process MODELS 


Most students of psychophysics believe that the single-process models of 
the type just described are too simple to account adequately for what underlies 
the subject’s response behaviour, At the very least they feel that the perceptual 
and decision stages of the process must be dealt with separately and that the two 
classes of mechanisms are somewhat different. Perhaps the most prevalent view 
is that the sensory process is static in the sense that it is totally unaffected by 
the contingency variables of the experiment and that all of the learning takes 
place in a decision process that converts the internal sensory states into responses- 
Thus, for example, in signal detectability theory one assumes that the normal dis- 
tributions over the continuum of states depend only upon the stimulation and the 
subject, but not on the payoffs or instructions, The contingency variables are 
assumed to affect only the subject’s choice of the criterion cm. Thus, the te 
Process is assumed to describe how the subject adjusts cm from trial to trial. 

Relatively little has yet been done in the learning literature that seems 
applicable to continuous Processes of this type. The only suggestion that lum 
aware of is due to Kac (1962) who postulated the following random walk for 
the criterion. Let cm denote the criterion and xm the internal state on trial m, 


then Kac assumed that 
A if s, is presented and Xm 7 Cm 
— A’ if s, is presented and x, < cy, (10) 
0 otherwise. 
An exact solution for the asymptote of this process is not known, but by making 


the approximation F(a+x) ~F(a)+xF"(a), where F is a cumulative normal 


distribution, Kac showed that the asymptotic expected criterion, Cw is the solution 
to 


Cm = Cm + 


NP ji © foi(a)dv=A(1 —P) i -falada 
where fs; and fs are the normal dens; s 
and sẹ. No tests of this model have 
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the first two terms of the Taylor series expansion of F is an acceptable approxi- 
mation. 

For models with a discrete set of states, it is relatively easy to introduce a 
learning process. In essence, one proceeds as follows. If state x occurred on 
trial m and was due to stimulus sx, then the probability of making the response 
rk that is appropriate to s; when x; occurs, P(rr|x), is increased. The 
probabilities of making any other response to x; are decreased, and the probabili- 
ties having to do with the other internal states remain unchanged. If one assumes 
linear operators—which is the only case that has been worked out (Luce, 1963; 
Norman, 1962, 1963)—then the asymptotic expected biases for the two-response 
and two-stimulus case are of the form 
ps Gals) d 
Deals) PCL” ie 


1—P)\ 6, 
v= (Da 
The response probabilities are given by 


barilss) = EP oral OCs) (13) 


where the p(x:|sx) are the stimulus parameters. For the Yes-No detection 
experiment, this leads to predictions of psychometric functions of the form shown 
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Ficure 3, The multi-stage threshold model psychometric function compared with the 


data of Fig. 2. The parameters of this curve were chosen to fit all of the data for 
subject 6, not just the data shown. 
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in Fig. 3. Data which suggest that such a complicated structure may exist have 
been obtained by Larkin and Norman (1963) and Norman (1962, 1963); a 
sample is shown in the figure. 

The iso-sensitivity curves for the multi-state threshold model of the Yes-No 
detection experiment, using parameter values appropriate to the data (which, 
among other things, means that only the first four states contribute significantly) 
are asymmetric curves, not unlike those of unequal-variance signal detectability 
theory but with a somewhat Sharper corner. A typical curve, fitted to data 


(Norman, 1962), along with the bilinear prediction of the two-state model (Luce, 
1963), is shown in Fig. 4. 
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a result of experience. Like all of the models discussed above, his has a fair 
number of free parameters to be estimated from the data, and this appears to 
give it adequate freedom to account for most of the functions that traditionally 
have been studied. In addition, he has focused considerable attention on the 
sequential properties of the data. It is too early to evaluate the adequacy of 
these results, especially since replications of nearly the same experiments have 
not yielded entirely consistent data. 


VI. CONCLUDING REMARKS 


The task of trying to incorporate learning ideas into formal models for 
psychophysical experiments has barely begun, and there are innumerable 
directions the research might take. I shall conclude by listing three of the 
directions that I feel would be most useful in the near future. 

1. A more complete learning analysis is needed to describe the adjustment of 
the criterion when there is a continuum of states, as in detection theory. Since 
various learning theorists have, for independent reasons, begun to work on 
continuous learning problems, perhaps some transfer of ideas will be possible. 

2. In the two-process models, there is a choice whether the learning applies 
to the sensory or decision process, and so it would be very helpful indeed if one 
were to be able to derive fairly sharp differential predictions that could be used to 
decide between the two assumptions. 

3. In several of the models, the response-bias parameter is expressed as a 
function of the presentation probability and the learning rate parameters. Since 
we know that payoffs affect the biases, it must be that the learning rate parameters 
depend in some fashion on the payoffs. They may also depend upon other 
things, including the presentation probabilities. A theory for their dependence 
upon, at least, the payoffs would reduce considerably the number of free para- 
meters and might very well lead to some interesting new predictions. 
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THE EFFECT OF ONE STIMULUS ON THE THRESHOLD FOR 
ANOTHER: AN APPLICATION OF SIGNAL DETECTABILITY 
THEORY! , 


By MicHEL TREISMAN 


Institute of Experimental Psychology, Oxford. 


If an accessory stimulus regularly precedes a critical stimulus at a fixed 
inter-stimulus interval then the shorter the interval the lower the threshold 
for the critical stimulus. ‘Three hypotheses which might explain this are 
discussed, and two experiments described. Experiment 1 shows that varying 
the intensity of an accessory stimulus does not affect the extent of the 
threshold fall it produces. Experiment 2 confirmed a prediction that 
randomizing inter-stimulus intervals over a small range would allow the 
threshold to fall as the mean inter-stimulus interval decreased at long mean 
intervals but not at short ones. Taken with earlier results, these experiments 
indicate that the subject lowers his threshold during a range of time about 
the end of the inter-stimulus interval in which he expects that the stimulus 
may occur. It is also shown that the extent of the fall in threshold is 
inversely proportional to the length of this range of expectation, and that 
the latter appears to be directly proportional to the duration of the inter- 
stimulus interval. 

This variation in threshold level is considered in terms of the model of the 
threshold provided by signal detectability theory. It is shown that the 
threshold falls are due to changes in the criterion computed by the subject, 
rather than in the sensory noise. This model is also successfully used to 
predict the extent of the shifts in detection rate that occur as the inter- 
stimulus interval alters, on the assumption that subjects attempt to keep 
their false positive rates constant. Finally it is suggested that in computing 
the appropriate criterion for each inter-stimulus interval the subject uses 
a simple approximate method rather than the more complex exact method. 


I. INTRODUCTION 


If an accessory stimulus is regularly given at a fixed interval before a critical 
stimulus it alters the threshold for the latter. Figure 1 shows the results of five 
experiments performed by Howarth & Treisman (1958). It can be seen that 
as the interval between the accessory and critical stimuli is reduced from 9 to 
1 seconds the threshold falls, slowly at first and then more rapidly. Curves 
1, 2, 3 and 4 show the absolute threshold for the electric phosphene, measured 
by the method of limits, and curve 7 gives the differential threshold for the 
intensity of a 500c.p.s. tone. A light-flash regularly preceded the critical 
stimulus for curves 1 and 2, a bell for curves 3 and 4, and a light for curve 7. 

1 I would like to thank Professor R. C. Oldfield for the provision of research facilities, and 
Mrs. J. Clarke for assistance with computing. Part of the work described here was done while 
was in receipt of an MRC grant. 
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Thus the effect does not depend on either the critical or accessory stimulus 
being in a particular modality. "Treisman & Howarth (1959) showed that the 
false positive rate does not increase as the threshold for the critical stimulus 
falls, so that this fall cannot be attributed to an increase in guessing. 

These experimental findings pose two problems: (1) How does the 
accessory stimulus have this effect and, in particular, how does the length of the 
inter-stimulus interval determine the extent of the fall in threshold produced 
by the accessory stimulus? (2) What mechanism of sensory discrimination 
allows a fall in threshold to occur without an increase in the false positive rate? 
The first part of this paper is directed to the first question. Different hypotheses 
to account for the effect of the accessory stimulus will be discussed, and two 
experiments will be presented which, taken with earlier results, allow us to 
prefer one of these hypotheses. The second part of the paper will develop 
this hypothesis in relation to the model of the threshold given by signal detecta- 
bility theory, and will show that the fuller account which this leads to allows 
predictions to be derived which agree reasonably well with experimental results. 


II. ALTERNATIVE HYPOTHESES 


To explain the form of the relation between inter-stimulus interval and 
threshold level two hypotheses have been put forward (Howarth & Treisman, 
1958, 1961; Treisman & Howarth, 1959): (a) The accessory stimulus causes 
an immediate arousal or alerting response, one effect of which is a rapid increase 
in sensitivity to incoming stimuli. The threshold curves obtained reflect the 
time-course of the decay of the physiological change underlying this. This 
will be referred to as the ‘arousal’ hypothesis. (b) The accessory stimulus acts 
as a warning or temporal reference point, allowing the subject to use his knowledge 
of the inter-stimulus interval to anticipate the arrival of the critical stimulus, 
and to lower his threshold when he expects it. Since he cannot determine the 
end of a time interval exactly, he will expect the stimulus over a range of time 
about the end of the interval. Thus if the inter-stimulus interval is 3 seconds, 
the variability of the subject’s measure of time might result in his expecting 
the stimulus to occur at times between 2:5 and 3:5 seconds after the accessory 
stimulus, but not earlier or later than this period, and to lower his threshold 
only during this one second range of intervals. The length of this ‘ range of 
expectation ' would be approximately proportional to the inter-stimulus interval; 
it is assumed that the threshold is lowered to an extent inversely related to the 
length of this range (Howarth & Treisman, 1958). This will be referred to as 
the ‘range of expectation’ hypothesis. (c) To these alternatives a third hypo- 
thesis can be added. This also assumes that the accessory stimulus functions 
by providing information rather than by producing arousal, but it supposes 
that the subject lowers his threshold immediately he receives the accessory 
stimulus, rather than waiting for and anticipating the end of the inter-stimulus 
interval. The threshold is lowered to a fixed level at which the subject maintains 


it throughout the time that he waits for the stimulus, or until he concludes 


B 
S.P. 
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that the trial is over. This waiting time would be about the same length or a 
little longer than the inter-stimulus interval. The subject uses his knowledge of 
the length of the waiting time to determine the extent of the fall in threshold 
instituted when the accessory stimulus is received: the threshold fall is inversely 
related to the anticipated waiting time. This will be referred to as the ‘ waiting 
time’ hypothesis. ; 

These hypotheses were tested by an experiment in which the subjects 
information about the length of the inter-stimulus intervals was reduced by 
varying them at random, on successive trials, between 0:5 and 5:5 seconds. 
Such a loss of temporal information should not affect a ' reflex’ physiological 
change, but it should make the subject unable to anticipate the critical stimulus 
successfully. It was found that the relation between inter-stimulus interval 
and threshold previously found was no longer shown (Howarth & Treisman, 
1958). 

"Though this tells against the arousal hypothesis it is not conclusive. It 
might be that the ‘ arousal response ' evoked by the accessory stimulus normally 
habituates (Pavlov, 1927; Humphrey, 1933), but that this is prevented when 
there is the ‘ reinforcement’ of having the critical stimulus come at about the 
expected time, In an experiment in which no temporal information is given 
habituation might proceed unchecked, the relation between inter-stimulus 
interval and threshold disappearing. Temporal information could, then, be 
needed to maintain the * arousal response ’, and might not be used to anticipate 
when the stimulus will arrive. We may also note that the result of this experi- 
ment is compatible with both the range of expectation and the waiting time 
hypotheses. In the latter case randomizing stimulus intervals might have resulted 


in the waiting time being the same on all trials. Two experiments which test 
these hypotheses further will now be presented. 


III. EXPERIMENT 1 


The intensity of the stimulus may affect the amplitude of a reflex, the length 
of reaction time, the direction of attention, and the rate of habituation 
(Humphrey, 1933; Oldfield, 1937). We might, therefore, expect an increase 
1n sensitivity due to arousal to be similarly affected. If, however, the accessory 
stimulus acts only as a temporal reference point its intensity should be irrelevant 
to its effect. This makes it of interest to see whether an effect of the intensity 
wn when it is used to cause a fall in the 
To test this two accessory stimuli were used, 
€ and the other considerably stronger but not 
wo inter-stimulus intervals, 0 and 1-5 seconds, 
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Apparatus 


The subject sat alone in a moderately illuminated experimental room, 85 cm. from 
a white cardboard screen, 50 cm. x 60 cm. in size. A ‘ pre-warning’ stimulus was used 
to indicate the onset of each trial. This was provided by a neon bulb covered with a paper 
shade and placed at the right edge of the screen, 25 cm. from the fixation circle. The 
subject wore Brown type-K moving coil earphones through which he received a constant 
500 c.p.s. 60-70 ds SL tone from a Muirhead audio-oscillator; the critical stimulus was 
a 40 msec. increase in the intensity of this tone. At the centre of the screen was a circular 
aperture 7 cm. in diameter which subtended 4? 40' of arc and was filled with a 0:2 Neutral 
Density Ilford filter. A fluorescent tube was contained in a lightproof box behind 
the fixation circle and some distance from it; when a 40 msec. pulse of current passed 
through it the light flash produced illuminated the circle diffusely. This constituted 
the accessory stimulus. Its intensity could be varied by placing neutral filters between 
the fluorescent tube and the screen. The brightness of the screen was 3-2 foot lamberts, 
the unilluminated fixation circle 0:40 foot lamberts. The * weak' (W) light flash was 
0:56 foot lamberts, and the 'strong' (S) flash 180 foot lamberts. To prevent the pre- 
warning stimulus providing any temporal information the interval between it and the 
accessory stimulus was randomized over a wide range. 

'The electronic timing circuits which were used to produce the random and fixed 
intervals, and the amplifier which allowed the intensity of the critical stimulus to be varied 
have been described elsewhere (Howarth & Treisman, 1958). Dekatron counters were 
used to record time intervals. 


Procedure 


At the beginning of each session the subject’s threshold was estimated using the method 
of limits. ‘The experimenter then selected four equally spaced intensities of the critical 
stimulus within the subject’s threshold range. "These were presented in series of 20 trials, 
each series consisting of 4 of each of the stimulus strengths, and 4 * blanks’, in random 
order, A series was given under one of five combinations of accessory stimulus and 
inter-stimulus interval: W/0, W/1:5, 5/0, S/1:5, and NAS (i.e., no accessory stimulus). 
Fifteen series, 3 under each combination, were presented during a session, in a random 
order different for each subject. Sessions lasted 1-2 hours. Five subjects (undergraduates 
and research students) each did one session. 

Each trial began when the pre-warning neon bulb came on (it sta 
ject had responded). ‘This was followed, after an interval varying at ran e 
and 5 seconds, by the accessory stimulus. The critical stimulus was given either simul- 
taneously with or 1*5 seconds after the accessory stimulus (or replaced it: the NAS condition). 
The subject responded ‘ Yes ' or * No’ by depressing one of two tapping keys. Reaction 
times were recorded, but subjects were not told that this was being done. 


yed on until the sub- 
dom between 2 


TABLE I. RESULTS OF EXPERIMENT 1 


Conditions (see text for explanation) 


Response Measures NAS W/0 $/0 wjrs  S/t5 
Threshold (dB): 0:576 0:511 0:518 0:536 0-500 
Standard Errors: 0-013 0:019 — 0:016 vo Mri 
False Positi er cent): 67 3:3 17 0: 

lis ed 1:108 1:010 0-849 0:723 0:804 


Reaction Times (seconds): 
Standard Errors: 0.077 0:04 
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Results 


The thresholds for each subject under cach condition were T 
by probit analysis (Finney, 1952). They are given in Table ye v» es 
positive rate is based on 60 ‘ blanks a The mean reaction times 2 
responses are also given. They are derived from 647 positive responses. 
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responses’ should not habituate. It follows that in this case the arousal hypo- 
thesis will predict a fall in threshold as the mean inter-stimulus interval decreases 
similar to that found previously. On the ‘ waiting time ’ hypothesis the threshold 
is kept constant at a lowered level from the time of arrival of the accessory 
stimulus until the subject has detected or no longer expects the critical stimulus. 
If the inter-stimulus intervals vary over a small range the mean waiting time 
should be about as long as the longer intervals; therefore as the mean inter- 
stimulus interval decreases the threshold should fall. The‘ range of expectation ° 
hypothesis leads to a different prediction. When the mean inter-stimulus 
interval is sufficiently long the range of expectation will be considerably greater 
than the range over which the intervals are experimentally randomized, so that 
this randomization will have little effect. When, however, the inter-stimulus 
intervals are sufficiently short for the range of randomization to be somewhat 
larger than the range of expectation, then the frequency of positive responses 
to a given stimulus will become constant, and it will not increase as the mean 
inter-stimulus interval further decreases. (This will be true whether the subject 
continues to reduce his range of expectation as though there were no experimental 
variation of the inter-stimulus interval—the threshold in the range of expectation 
would fall but so would the proportion of stimuli falling within this range—or 
ceases to reduce it once it equals the range of randomization.) Thus this 
hypothesis predicts a decline in threshold as the mean inter-stimulus interval 
decreases, for longer intervals, but a plateau for the shorter intervals, where the 
other two hypotheses predict the steepest falls. 3 $ 

Inter-stimulus intervals ranging between 0 and 3 seconds were used in this 
experiment, since in the earlier work the largest falls in threshold occurred 
here. The range of expectation at the middle time interval was estimated by 
supposing it would be approximately equal to 5-6 times the differential threshold 
for temporal duration, AT, when the latter is defined as the standard deviation 
of productions or reproductions of a time interval, T. In an experiment 
described elsewhere the relation of AT to T was determined. This BANS AT= 
0-19 seconds for T'—1:5 seconds, so a 1-second range of randomization was 


chosen (Treisman, 1963 a). 


Apparatus 


o neon bulbs at its centre. 
y stimulus was provided 
d on each trial. 
Subjects responded verbally ‘ Yes’ or * No’; they were in telephonic communicata 
with the experimenter. ‘The remaining apparatus was as in Experiment 1. The criti 
stimulus was a 50 msec. increment in the intensity of the constant 500 c.p.s. tone. 
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TanLE IL. PERCENTAGE OF POSITIVE RESPONSES FOR EACH CONDITION OF EXPERIMENT 2. 
Inter -stimulus interval, or * Sub-range’ midpoint 
(seconds): | 0:25 0-75 1-25 1:75 2:25 2:75 
Constant 
Condition: 
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V. PRELIMINARY THEORETICAL ANALYSIS 


The results of the last two experiments, like those obtained by Pieria 
Treisman (1958, 1961) and Treisman & Howarth (1959), peere w ue 
the 'range of expectation ' hypothesis rather than alternative exp ana atel 
If, then, we accept that the threshold is lowered for a period about the as E 
time of arrival of the stimulus, we must stil] consider whether this fall is inv Ms 
proportional to the duration of the Tange of expectation, as assumed by thi 
hypothesis. 
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Se ep ae 
which showed an effect of inter-sti tas ees pue d umm 
Sak. mita : of inter-stimulus interval on threshold, using the least 
Figure 1 ces vie fit. The curves obtained for these data are shown in 
m ed e e seen that equation (1) gives a very good fit to the data, 
be ier ing the range of expectation hypothesis. It is also of interest that 
Ese constants are considerably smaller than those obtained in the time 
sinn wir For the five conditions, the values of a obtained 
crm Ph m 5, —0:15, 0-15 and 0-25; they are small and distributed 
Me cipi. ce mean is 0-01). If in each case a is made equal to zero the 
a : 33 ting A are almost indistinguishable from those shown in 
c als r e ma e egual to 1-57 sec., however, satisfactory fits are not 
m s all five conditions the experimental points at the two extreme time 

ervals fall below these best-fitting curves, and most of the other points lie 
above them. 
; It seems we now have an answer to the first question posed in the introduc- 
tion: the fall in threshold produced by an accessory stimulus can be attributed 
to the subject lowering his threshold during a range of expectation about the end 
of the inter-stimulus interval to an extent inversely proportional to the duration 
i ci range. It also appears that this range is directly proportional to the length 
fo " inter-stimulus interval, this relation not including the additive constant 
1 und in the Weber function resulting from temporal discrimination tasks. 
f we are to answer the second question We must now consider the mechanism 


of threshold change in more detail. 


VI. SIGNAL DETECTABILITY THEORY 
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The most successful account of sen 
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54; Gregory, 1956; Barlow 1957; Green, 1960; Swets, Tanner & Birdsall,, 


a ; Treisman, 1963 b), and it appears likely to be applicable here (Treisman & 
owarth, 1959). Some elements of the theory relevant to the present problem 
will be briefly outlined. 

_ Signal detectability theory treats sens 
distinguishing signals in noise. It is assumed 


ory discrimination as à problem of 
that when a stimulus is presented 
», which is used to determine the 


to a subject it produces a central neural effect, : 
response. Ifa given stimulus is presented repeatedly the central effects produced, 
ditional probability density function 


[o Xa ..Xp.. Xm are described by a con 
sx (x) which is normal with mean Mgy and standard deviation osy this is the 
bsence of the stimulus central 


(Y 

bos + noise’ (SN) distribution. In the a of the s 1 

es ee A which are described by a ' noise ' (N) distribution, fx). with 

eet an: and standard deviation «y. In the simplest case 1t 1S assumed that the 
wo distributions have equal variance. If the subject must choose between two 

responses, ‘ signal present’ (A), or * signal absent ' (CA), he will achieve optimal 

performance by comparing the likelihood ratio A(4:) corresponding to the central 
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to identify x, he must know both fy(x) and f,,(x). These requirements restrict 
the model to procedures where the subject is well-informed; it cannot readily 
be applied to the discrimination of stimuli which are imperfectly known or 
unexpected. For example, when the method of limits is used the stimulus 
values presented depend partly on the subject’s responses; he may not know 
the proper form of f,,(x) until the conclusion of the experiment. In this method, 
furthermore, P(SN)=1 and the maximal expected value criterion should then 
be B —0, but in practice very similar thresholds are obtained with this method 
and with procedures in which P(SN) «1 (Treisman & Howarth, 1959). Con- 
pa the theory is not usually applied to procedures such as the method of 
imits. 

An alternative approach to the optimal criterion, that suggested by Neyman 
& Pearson (1933), has sometimes been used (Swets, Tanner & Birdsall, 1955). 
This requires P(A) to be maximised, subject to P(A) not exceeding a constant 
limiting value, e. £ is then that value of A(x) for which 

Py(A)=e. (3) 

_ _ Since this definition requires less foreknowledge on the part of the subject 
it is more widely applicable. In order to determine xe it is not essential for the 
subject to calculate 8; he need only be able to make some estimate of the value 
of Pp(4) when he has adopted an arbitrary initial critical value of x (which he 
should ordinarily be well able to do, since daily life affords many opportunities 
to make difficult discriminations which can later be verified), and to vary this 
criterion until Py(A)=«. The Neyman-Pearson definition is not in conflict 
with the finding that subjects may vary their criteria if monetary rewards or 
announced values of P(SN) are altered (Swets, Tanner & Birdsall, 1961); such 
factors could act by altering the value of € preferred by the subject. In the 
application of signal detectability theory to the present problems it will be assumed 
that the optimal criterion is computed in the Neyman-Pearson fashion. 


VII. APPLICATION OF SIGNAL DETECTABILITY THEORY TO THE PRESENT PROBLEM 


In applying a theory of this sort to the problem of analysing human 
performance three stages can be distinguished. In the first stage we must 
determine whether the theory adequately describes the overall relations between 
Input and output. Signal detectability theory defines the course of action leading 
to optimal decisions when difficult discriminations must be made. We must, 
therefore, ask questions such as: Do subjects’ decisions approximate to optimal 
decisions? When the experimental conditions vary does performance alter in 
the ways that would be expected if the theory properly describes the course of 
action being followed? Evidence such as the appropriate shape of subjects 
ROC curves, etc., has tended to give positive answers to these questions, allowing 
US to accept the theory at this level. The second stage is the determination of the 
Proper description of the operations the subject is actually performing: con- 
Sidered as a computer, he may not follow the signal detection programme 1n 
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distribution changes, then the fall in threshold which it causes must have some 
latency and could not occur when the accessory and critical stimuli are simul- 
taneous; still less when the critical precedes the accessory stimulus. 

A test of these alternatives is provided by experiments in which Treisman & 
Howarth (1959) examined the fall in threshold as the inter-stimulus interval 
was reduced from 1-5 to 0 seconds: the threshold fell continuously as the interval 
was decreased and was minimal when the stimuli were simultaneous. When 
the accessory stimulus followed the critical stimulus it continued to produce a 
significant fall in threshold up to intervals of 0-5-1-0 seconds. This shows that 
the subject’s decision is not uniquely determined by his physiological state at 
the moment at which the stimulus is given; rather it appears that inputs can be 
stored for short periods, and if the accessory stimulus arrives before they have 
decayed the criterion can then be lowered and applied to them. It is of interest 
to note the similarity of the interval—0-5-1-0 seconds—for which inputs appeared 
to be stored in these experiments to that found for the decay of peripheral sensory 
information by Sperling (1960) in experiments on the span of apprehension. 

The theory of signal detectability has now been applied to the accessory stimulus 
experiments, and it has been shown that in terms of this model the falls in 


threshold which were obtained can be attributed to computation changes in 
criterion rather than distribution changes. 


However, it still remains to see how 
a computation change in threshold could be related to the duration of the range 
of expectation in such a way as to produce the inverse relation between 
threshold fall and range of expectation found earlier, together with the 
constancy of false positive rate which was the second major problem noted in the 
introduction, Moreover it would further strengthen the case for applying the 
Signal detectability model if it could be used to make quantitative predictions 
about the extent of threshold changes and these could be shown to agree with the 
data. These problems are pursued in the next section. 


VIII. CHANGES IN CRITERION AND THE RANGE OF EXPECTATION 


How could variation in the range of expectation affect the computation 
of xe? The signal detection model describes a decision procedure by which 
subjects can select answers to questions such as ‘ Was the signal present or 
absent?’ It is assumed in applying the model that the subject makes one such 
decision for each response. But when there is a waiting time which affords 
more than one opportunity for the stimulus to occu then more than one 
decision might precede a response. Only if all the decisions were negative 
would the response be ‘ no’; if one or more decisions were positive the response 
would be ‘yes’. In this case the false positive rate (FPR), i.e. the proportion 
of positive responses to ‘ blank’ stimuli obtained experimentally, could not 
be taken as a simple estimate of P (4), the probability that a value of x 
occurring centrally in the absence of a stimulus will exceed Xos since on any 
trial several values of x may be tested, yet only one response 3S made. The 
question arises whether in this case the Neyman-Pearson criterion should be 
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If T, is shorter than T, so that 7, is less than 7, it follows that e; will be greater 
than e, i.e. the criterion employed during the range of expectation will shift 
from xc, to a new lower value xe. Figure 3 shows how the increase in e producing 
this shift (represented by the dotted area of the ‘ noise ' distribution) is accom- 
panied by a corresponding increase in P,4(4) (the lined area of the SN 
distribution). It is apparent that if we know e, and e, the corresponding shift 
in criterion can be calculated by taking the standardized normal deviates of 
the N distribution corresponding to these two probabilities, z and 2, as 
measures of we) and xe. If we know Psy(A)) we can then, on the assumption 
that the two distributions have equal variance, find the expected value of Ps (4), 
by consulting a table of the normal curve. For example, if co = 0:0227 (2, 5 2-00) 
and e, is found to be 0-1587 (2, — 1:00), then if the detection rate for a stimulus 
is 50 per cent. when it is presented at Tọ, we would expect the rate to rise to 
84 per cent. at T,. Since the stimulus is given at only one moment on each 
trial the detection rate can be taken as an estimate of Ps,(A); this is not strictly 
accurate, since on trials on which the stimulus is presented some of the positive 
responses will nevertheless be due not to the central effect of the stimulus 
but to the effect of * noise ’ at some other moment in the trial, so that a correction 
analogous to the ‘ guessing correction’ should be made. But this effect is 
unlikely to be large and will be disregarded here. | | 

Data suitable for comparing predicted and obtained detection rates are 
provided by the Constant Condition of Experiment 2, and by Bue 
1(a) and 1(b) of Treisman & Howarth (1959), since in each iE the 
Same stimuli were presented by the method of constant stimuli at more than ae 
inter-stimulus interval, and most of these were not very short. Md er 
the assumption that the ‘ noise’ and ‘ signal + noise variances are equal is 
plausible for these data since oy represents the variability of the central response 
to a tone 60-70 db. above threshold, and cs, that of the response to a tone a 
fraction of a decibel louder. In order to derive predictions the value of e must 
be known for at least one inter-stimulus interval. A value was estimated, some- 
What arbitrarily, by taking T,— 10 seconds and supposing that any change in E 
during the course of this interval was negligible. Taking RE E PRODIRE 
the average value in the experiments to be examined, and ies n PS 
number of moments in T,, using Stroud’s (1955) estimate of 10 qwe 6 
moment) in equation (4), «, was found to be 0:00043. ou M ns m 
and (6), values of e and z for other time intervals were compute : See 
stimulus strength the frequency of positive response at the longes 1 Gm 
the experiment was taken as the starting-point, and the detection rates Mi A 
intervals were predicted from the shifts in 2. These predico are ke b 
Continuous curves in Figure 4, for the Constant Condition o aS eh 
and in Figure 5 for stimuli used in E sman 


xperiment 1 of Treisma ae 
(1959). Each response percentage is based on 160 responses in Experim 
2, and 240 for the 1 and 8 second intervals, 


and 80 for the 3 and 6 second 
iati tween 
Intervals in Figure 5. Allowing for error variation, the agreement bety 
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best-fitting curve of the form (4-2) (T+a)=k (compare Pn () A E. - 
clear that this function would supply very good estimates [) 2 e valu x Ki 
appropriate to the different inter-stimulus intervals within this a ae 
less curved than the best-fitting curves in Figure 1, since it has a= k Fr 
continuous curve is the best fit when a =0. It would give good but not op : 
values of x, and is similar to the curves in Figure 1. This brings us to a sug : 
gestion which is more an hypothesis for future research than a eenchusiotte 
when the inter-stimulus interval is varied the subject aims at optimal behaviour, 


as defined by equations (4) and (5) and the associated calculations; however 


relation (A-x,) T — &, giving 4 
constant. 
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Some of Thurstone’s data are reproduced in Table I. i If the percentage who 
judge rape to be more serious than a particular crime is greater than the at i 
centage judging homicide to be more serious than the same crime, then rape wi 

have the higher scale value in that pair of comparisons. This is the situation to a 
marked degree in the case of the three sex crimes, abortion, adultery and 
seduction. The fact that these three give the largest difference in favour of 
‘rape’ suggests that sex crimes of which rape is one are being judged on a 
different dimension from the one operating with the other crimes. Thus the 
inconsistency observed is explicable in terms of a two dimensional space rather 
than the single dimension usually assumed in applications of the method of 


paired comparisons. There is clearly a need for multidimensional analysis of 
these proximity data. 


TABLE I. PERCENTAGE OF OCCASIONS ON WHICH HOMICIDE AND RAPE ARE JUDGED TO BE 


MORE SERIOUS THAN OTHER CRIMES (Thurstone, 1927) 


Homicide Rape 


Abortion 76:0 81-2 
Adultery 86:3 92-5 
Seduction 81-9 92-4 
Rape 55-9 (50) 
Kidnapping 91:7 90-2 
Assault 97-0 94-7 
Burglary 9841 98-1 
Vagrancy 98-9 98:5 


but rather that inconsistencies will occur 
In an actual experiment 
€ a simple matter to test 


sistency, If it were found that a high percentage 
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m VE a unidimensional scaling methods were developed and used during 
inthe s and Guttman developed his procedure for scaling persons and items 
The Sea pains. i took account of individual differences in scaling items. 
pereat of extending scaling to the problem of establishing more than one 
qe n "e also developed in that period although not applied extensively 
ee id orgerson (1952). Towards the end of the 1940's Coombs (1952) 
en a a method of representing persons and stimuli in the same single 
dim sion using ordinal methods. This method was exten ¢ 
es ac by Bennett and Hays (1960). Tucker and Messick (1963) have 
ae y extended the method of Torgerson to the case in which individual 
St rences can be taken into account and their effect on scale values assessed. 

heppard (1962) has presented an alternative method of analysing ordered 


di ; 
istances. "The purpose of the present paper is to illustrate the sort of result 


aa by the multidimensional analysis of rank orders following the method of 
ennett and Hays, and to compare this with that obtained by the alternative 


multidi ; . 
ultidimensional analysis of Torgerson. 


II. PREFERENCE AND JuDGED DISTANCE 
nnection between 


the E must be conceded that logically there is no necessary co nod 
and S e method and the multidimensional unfolding met o P d 
lar AYS BNCE the rank order analysis depends upon the existence 0 rela a 
1 eedem differences and ideally the quantitative analysis requires al 
ndividual differences be as small as possible. The former depends on the 
Tod that persons and stimuli can be arranged so that the order of the distances 
Im each person to the stimuli corresponds to t :nc of the stimuli by the 
Person. "The quantitativ method de ends 
Tudge the diste reet each pei of stimuli, or more simply, ca decide 
oue the distance between stimuli A and B is greater oT less t n 
etween stimuli C and D irrespective © or identificati 
Person, Even though there is no logical for results using rd s 
PRE to be related, it is still a matter of empirica to discover if they 
e, in particular cases. It is in this spirit that, 
15 m i: he first study, six of the nine stimuli © ee. 
we possible pairing were presented to each of 250 subj 3 
B re rape, murder (homicide), adultery; seduction, ass 
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a with the other four. However, Aa 
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e thi isi reviousl made. Ín this way ! 
ensure dee Me pe bering Vs a function of the gare oe ed 
LT an expression of his desire to appear € In e ad E : Ea en 
bón asked to indicate which of the two stimu : 
est or disliked least. In addition the subject was asked to T 
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between the stimuli on factors which affected his preference. The data were 
analysed in three ways: 


1. Thurstone’s method of paired comparisons (case V) yey E 
proportion of occasions on which stimulus A is chosen over i a 
transformed by the cumulative normal distribution and averaged for 
stimulus to give a scale value (see Torgerson, 1958, p. 159ff.). 


2. The ratings of distance were converted to scale values using the € 
of successive intervals (see Torgersen, 1958, p. 227ff.). After the addition of t 
appropriate constant to make them positive, the 
to scalar products and factored following Tor 


3. Where subjects gave completely transitive preferences, these could be 
converted to a unique ordering (i.e. with no ties). From these orders decisions 
as to the dimensionality of the stimuli and their location within these dimensions 
could be made following Bennett and Hays (1960) and McElwain and Keats 
(1961). 

The results obtained from the 
be noted that the women thought 


se distances values were converted 
gerson (1952 and 1958, p. 280ff.). 


first analysis are given in Table II. It will 


NE COMPARED WITH THOSE OBTAINED ON A 


QUEENSLAND Group 
Thurstone Queensland Queensland 
Men Women 
Burglary 1:51 1-26 0:87 
Assault 1:47 2:06 2:00 
Adultery 2:10 1:90 2:24 
Seduction 2:29 1-41 2:06 
Rape 3-28 3:25 3:25 
Homicide (Murder) 3-16 3:91 3:36 


The multidimensional analysis of distances yielded three dimensions 
in the case of the six stimuli, but when burglary and assault were combined 
only two dimensions were necessary, This example is presented because of 
| A (Adultery) 

P8 ila 


o 
B (Burglary and 
A 


9 R(Rape) 


9 Murder) 


Ficure 1. Multidimensional Scaling of Five Crimes. 


(See text for detail.) 


W——————o 


SR 
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its relative si er S 

iiec i I Figure 1. It may be noted that the second factor 
I drdh sex crimes from the remainder. 
mately 80 y a: data were converted to rank orders and 
hypothesis m ii cases gave consistent orders. Under the randomization 
or 2-2 per cent un e the probability ofa consistent ordering is 6! [215=0-22 
With, the sd 2 h five stimuli this percentage rises to 12 (approximately). 
Sipiifiexntly gr » of cases involved (250) it 15 obvious that 80 per cent is 
TES greater than 12 per cent. 

Trl Brie of the multidimensional unfolding method 
So hat ies s for the unidimensional analysis i.e. that $ 
"mn rders that do occur in subjects' responses can occ! 
mple with three stimuli A, B and C if the two pos 
then the stimuli might 


B rank 
= p are never given by subjects, be represented 
aight line with B in the middle. From Figure 2 (a) it can be seen that 


w 

hee an pd points to the left of the midpoint of AB correspond 

DE er B C since the points AB and C are in that order of proximity 

BCAa yes to the left of the mid-point of A B. Similarly the orders B A C, 

Howev BB BA can occur in this figure but zot the orders A C B and CAB. 
ver if the point B is lowered so that now the three points define a plane 


and : s : 
the perpendicular bisectors of A B and B C are extended to meet as in 
Thus with three 


it was found that approxi- 


for rank orders is 
timuli are arranged 
ur in the diagram. 
sible orders with 


Figur 
een 2 a, then these two orders, A C B and C A B do occur. 
iin two dimensions all of the six possible orders are available. With four 
lied restriction on the orders 


some imp. 


stimuli i E K 
ili in two dimensions there is again 
iction on the a 


pU wm and a corresponding restr 

cannot b or example, if one point lies within the triangle of the other three 1t 

nod ien placed last (McElwain and Keats, 1961). The order corresponding 

in de ; icular region is the order of the proximities of the stimuli to each point 
region. 


(2) 

f Rank Orders. In (a) objects A, B and 

Je dimension. The segments of the lines bounded by the 
eh have distances from the three 


vertical lines indicate points (i.e. perso 
objects which are in the indicated order. In (b) B has to be placed below A and C, 
to permit the representation 


and perpendicular bisectors of AB and BC are drawn 
of the orders ACB an be achieved in (a). 


d CAB which cannot 
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imuli i i ould 
Both the six stimuli and the five stimuli orderings of the einer. 
be fitted fairly adequately into two dimensions using Wes Rrineiples wi Eje 
0 i i for in the latter case. 
tent orderings accounted for 3 
90 per cent of the consis € s i opimis 
i f a third dimension, but many mori S wc 
was perhaps a suggestion o um 1 = qh ae 
i i S established. Figure : 
ired before this could be regarded a A 
ee of stimuli and persons which would account for as many order T 
as possible. The lines are the perpendicular bisectors of the lines. Pe 
t and each area enclosed by these lines corresponds to a particular o 
» 


H H * x . in 
of distances from a point in this area to the stimuli, i.e. to a particular ordering 
given by a subject. 


AMSRB 


A 
M 


[ suu EXON 
f NA, 
BM Bh Ris 


Analysis of the Ranking of Five Crimes. The figures in 
umber of subjects exhibiting the correspondi 


€ ten perpendicular b 
> it is possible to discove 


Multidimensional 
each area indicate the ni 


ng order. 


NK ORDER Data 


a basis for dividing the original group 
However, although neighbouring subdivision 


The analysis of rank 


of subjects into sub-groups, 


"n 


By 
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correspond to di a 
in feeling Die uiro d they may not correspond to marked differences 
wie also nekedto 1 Em i. To examine this point more carefully the subjects 
the objects or Es licate whether they liked, disliked or felt indifferent towards 
pond dee we Bie iter represented by the stimuli. Neighbouring groups 
whit 5 1 pared to determine whether their slight difference in ordering 
some Sense ‘an, uw or small difference in liking. 1f this difference is large in 
People-with quite i may be thought of as strong since it separates 
LO alie ipa Xm views. In the case of the crimes only a very small 
Diseno Ar M uid e boundaries could be thought of as strong in this sense. 
‘artists *, * ue y ed elsewhere (Keats, 1962) the stimuli ‘ saints’, 
Of the stimuli? and ‘scholars’ were used and the percentages liking each 
boeing region ‘or each of the determined rank orders were calculated. Neigh- 
Detweci ^ m could thus be compared by assessing the significance of difference 
Raker hei adt deri e If this difference is significant this fact can be 
Vugeavora sire e a at a strong boundary separates the two regions. In this case 
When the ae | oundary, separating those who put ‘ saints ? Jast from the rest. 
Stuns, Tee, db istances were analysed multidimensionally for the contrasting 
differant EE Es who put ‘ saints ' first and those who put them last, quite 
Tainta fret x imensional arrangements Were obtained. The points for the 
group when i ee accounted for a high percentage of the orders of the whole 
but that of the terpreted ia; terms of the multidimensional unfolding model, 
orders, Wh saints last " groups accounted for only 60 per cent of the total 
at was not noted at that time Was that this 60 per cent Was made up of 


100 
per cent of the orders for people who put ‘saints’ last but only 49 per cent 
a possible generalization, 


of th 
e orders for people who did not. This suggests 
boundaries tend to distort 


le. th 
at people who are on the negative side of strong 
ween stimuli in such a way as to preserve 
"This 


thei s 
vas Puis ig m of the distances bet 
Eerie orderings but to eliminate orderings conflicting with these. 
e. nu will be examined with respect to a third set of stimuli. 
also with ird set of stimuli to be considered was used in the same study and 
Theat ae group so that approximately 500 subjects were available. 
for the Qi i consisted of the five political parties regularly contributing candidates 
Ainteah ueensland State elections, ie. Liberal Party (L), Country Party (©), 
ralian Labor Party (A), Queensland Labor Party (Q) and Communist 


P 
arty (K). The analysis of rank orders gave à Very good fit with two dimensions 
trong boundaries indicating that 


lip in Figure 4, but there were many $ h 
ERA minor change in the order of political parties can be associated with 
xm P EHE feeling. This of course was particularly true when the first choice 
grou b Lm In this example it was possible to isolate a quite homogeneous 
The dis Liberal voters and a fairly homogeneous group of Labor voters. 
uium i ie ratings were analysed separately for these two groups and the 
the two re presented in Figure 5. ‘These ratings indicated two dimensions when 
groups were treated separately, but the ratings for the whole group 


requir ; È s Jupe x 
quired four dimensions. There 184 basic similarity 10 these two representations 
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ala AML 


A- Australian Labour Party 
C- Country Party 
L- Liberal Party 
K- Communist Party 
Q- Queensland Labour Party 


Labour Voters 


Liberal Voters 
Cony 


*Q 


so 
er 


ex 
D 


o> 


K 
FIGURE 5, Multidimensional Scaling of Five Political Parties, 
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> 
» 
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with th 
le Ge de shown as furthest from the Communist Party whereas 
leak tothe ae orders shows the Queensland Labor Party as in greatest 
opere cat Party. Ideologically the latter would appear to be 
Su Commis ix Dee nud as the Queensland Labor Party is violently 
ily ta die ir s po icy. The difference between the two diagrams arises 
what mighf be wer. this party. The Liberal voters see it as belonging to 
Ene vie T ipee ond "E socialist group but the Labor voters see it as grouped 
IF di fo realized ountry parties. This distortion is more understandable 
ized that the Queensland Labor Party had been in existence for only 


a few year i 
years when this survey was made. It is rather interesting to note that both 


d E ur parties disown it. 
Term i eu ien an excellent one for testing th 
ther iine dos es on the negative side of strong boundaries tend to distort 
Sii orderi o : e distances between stimuli in such a way as to preserve 
representadiats ings but to eliminate orderings conflicting with these. The two 
model by drawi ae in Figure 5 may be interpreted in terms of the unfolding 
30 possible ving h he 10 possible perpendicular bisectors of the lines joining the 
pem Lr points. The bisectors will generate regions corresponding to 
to aiy bir ca e ways of ranking the five points in their orders of proximity 
Bou c ie the region. In this way a maximum of 46 orders can be generated 
of the le, hei mes but since the arrangements differ in their location 
different be Labour Party and in other ways they will generate some 
Eon be d or du These two sets of orders may then be compared with those 
expect 1 e subjects to discover how closely they correspond. It would be 
ed from the generalization that the arrangement for the Liberal voters 


Ww 
ould exclude some of the orders (and thus some of the subjects) which have the 
The location of stimuli 


ep Labor Party in first position and vice versa. 

die viris Party voters accounted for 83 per cent of the orders and 99 per 

Pave b. the cases who put the Liberal Party first but for those who put the Labor 

for fe only 33 per cent of the orders and 29 per cent of cases were accounted 
. The corresponding figures for Labor voters were 78 per cent of the orders 


and 85 per cent of the cases who put the Australian Labor Party first but only 
iberal Party first even though 


tag cent of the orders of people who pu rty | 
: accounted for 87 per cent of such cases. zation seems to hold 
us well for this example when orders are considered but breaks down some- 
sii 3 for individual cases because of the high frequencies in t 
ith the Liberal Party first. 
b A further example illustrates one way in rams Oa 
2 the analysis of rank orders can be influenced by personal identifications. 
n a survey of accommodation needs, students at the University of Queensland 
Aug asked to rank the four possibiltities, living at home, in a University College, 
a flat or apartment and in a boarding house in order of their preference. 
; iewed and an initial 


: here were approximately one thousand students interv l 
nspection of the orders given revealed that all twenty-four possible orders 


e generalization suggested 


which the diagrams obtained 
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AB 
hi cB 
[ 
FCPB  (CFP)8-37 
2 
crPB 
3 
D 
C 
CFPB)S V 
B 
B(C) 
cera 
l 3 
P(FBC)-78 
BPCF |PBCF |PCBF | ceper N 
, 0 n 24 5 b?" 
B A 
Am OH 
(PCB)F=40 


A- (8) Boarding House (B) 
B- (6) College (C) 

C- (0) Parents (P) 

D- (4) Flats (F) 


FIGURE 6. Accommod: 


subjects exhibiti 


ation Preferences of Stud. 
first or last is gi 


ents living at Home. The number he’ 
ing each order it shown. Also the number placing an d 
ven. E.g., the equation P (FBC)=78 gives the number favouring P- 


(PBF)C=3 
op ^jB 


PFC)B = 
(PBC)F = 36 Ead 


B 
A PBCF 
2 


4(6) Boarding House (p) 
B(6) Flats (F) 
C (4) Parents (P) 


0(2) College (c) 


FiGURE 7. Accommodation Preferences of Students living in Colleges. 
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Aja A/D 
8 AC 
Cro Pcar |acr/ PBFC 
3 1 4 3 
b s 
Y P(CBF)= 33 
p 4 i 
ACDB 
CPFB 
J rey 4 BREC 
p—— an TO 
D BC/ ^ 
C(PBF) =17 eT, Y 
/ BFC 
PF)B= 
VCPEIBe AS crpg oF) 
s / (BPF)C=25 
\ F(PCB)= 46 
E j 
' y 
ter FcBP FR| FBPC 
4 a hey ag 
(cFB)P=19 
(74 alo als 
ac 
A (8) college (C) 
B (6) Boarding House (8) 
C (3) Parents (P) 
p (3) Flats (F) 
FIGURE / 
? 8. Accommodation Preferences of Students living n their own House or Flat. 
j 
D 
E: 
PFBC 
4 
B 
P(cF8)- 55 
: 8 
ACOB 
CPBF 
F(PBO=4 
$ [J 
F Met [rl 
C (PFB) £16 B 
(CBP)F- 52 Fef 
9 
f 
c 
(cBF)P=10 
A (6) College (C) 
B (6) Fiats 
C (3) Parents (P) 
p (3) Boarding House (B) 
Boarding. 


h e 
FIGURE 9. Accommodation Preference of Students who are 
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were well represented, i.e. that three eames Erbe cm EE 
the entire data. When the data were c assified ac COL Asie It. 
actually lived it was found that representation in two dim Magari 
i up very well, but a different diagram wa i 

REA d ee a highly penifieant Chi square for a comparison hr 
dic frequencies in the critical areas distinguishing the various eg 2 
examination of Figures 6-9 reveals that for students living at d us dl 
central stimulus, but for students living in other types of accommodati E e 
particular type is contrasted with home. There were no notable 2 sup 
differences in type of diagram, and in fact the Asian men present in the € 
showed choice patterns which conformed to the diagrams presented, men a. 
as the Australians. Thus two of the three dimensions necessary to ee aad 
these data appear to be the actual place of living and the contrast between thi ex. 
home. The third dimension contrasts University College with flats and boar a 
houses. Closer examination of these diagrams reveals very clearly that Univers 


$ à ion for 
Colleges provide the most satisfactory alternative form of accommodation 
students unable to live at home. 


IV. APPLICATION TO HEIDER’S THEORY Or BALANCED RELATIONSHIPS id 
The primary purpose of the present studies was to obtain data which er. 
enable the results obtained by different Scaling procedures to be compar 


Va HN P. a 5 : to 
These results have intrinsic interest, but in this case they also contribute 
what is probably the primary function of scaling theory, 


tative procedures by which psychological theories can be 
Berger, Cohen, Snell and Zelditch (1962) have formali 
balanced relationships between a given person and ot s. Ti 
This formalization related persons and objects by dynamic relationships, ^^ 
e.g. like, respect, etc. and U, e.g. owns meets, works with, 
In general a system of persons ar 

objects is balanced for a person, for example if all his relationships are pos 
hips as positive, Berger et al. (1962, 
Heider and three of these have reference 
to the empirical work reported here. Proposition 1 (Balanced status); 

no balanced state exists then forces towards this state will arise. Either thé 
he unit relations will be changed through 


ie. to provide quam 
assessed and extended. 
zed Heider’s theory ° 


Ay 
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es nd en methods represent some of the types of structures that can be 
Bum oe p that lack balance in this sense. The generalization 
ges fu pans are to perceptual distortions which preclude the possibility 
hon wi D : Sew illustrates a type of perceptual blindness. Consider a 
bins. ie Us ikes scholars, heroes and artists in that order but dislikes 
Gato c" ing to Heider p, can conceive of, but will tend to dislike, a person 
D oos aic saints, artists and heroes in that order but dislikes scholars. How 
viden x ^ - a person (ps) who likes saints, scholars, heroes and artists in that 
dislike p te hieve balance pı must like pa because they both like scholars, but 
ce expan he (Ps) likes saints who are disliked by Pr: People of the type 
le si 1 ipa difficult to conceive of people of the type Ps and it is precisely 
the coil v e y these people which are excluded from the configuration of 
schien all fs perceived by people of the type pr In fact this configuration 
Pa nu ur orders which place saints and scholars together at the beginning 

preference order (see Keats, 1962, p. 358). Similar arguments can be 


dev. à 
eloped to explain examples of perceptual blindness arising in the study of 
ed by more stimuli and a 


"Sane Gra but here the situation is complicat 
types of "à ence of negative feelings. In the case of students preferences for 
the subj commodation, the Heider theory of balance accounts for the fact that 
ject's own place of residence and the comparison of this with home, give 


rise to : : 1 
separate dimensional spaces, one for each type of residence. 


V. CONCLUSION 

E. studies reported illustrate the sort of result obtained by the multi- 
inter sional analysis of rank orders in which it 1s assumed that this order can be 
m ias as the order of proximity of the subjects to the stimuli. When 
thie metho s method of multidimensional analysis was used in conjunction with 
method od it was found that where there were few strong boundaries, Torgerson s 
but produced scale values which accounted for the rank orders quite well, 
where there were many such boundaries, the Torgerson scale values were 


aff B . B 
ected by the location of the subjects. An analysis of the distance ratings for 
dimensions are by no means sufficient 


t 
vb one group might indicate that two nsion: j ae 
by co unt for the distance values, but when individual differences are x uce: 
sions nsidering only subjects with very similar orders of preference ae ime 
per iu be sufficient, as Was the case Wit 1 Pe. n Rs 
stud ptual distortion or blindness were d both this case oM 
to Ss idealized persons. The data obtained by t Qum A ye d 
EFC RE Heider's theory of balance and lend it some empirical suPP = 
Seem imensional analysis of rank orders with the à pu : 
mist: eh have particular application to field theory, although it wou ea 
ps a to link a particular method of scaling too closely W 

chological theory or vice versa. 

SP. r 
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ITEM ANALYSIS BY PROBIT AND 
FRACTILE GRAPHICAL METHODS 


By Rura S. Das 
Indian Statistical Institute, Calcutta 


This paper considers five basic questions of item analysis and describes an 
ich utilizes the methods of 


integrated approach for obtaining the answers whi 
Item difficulty is interpreted as the limen 


at which 50 per cent of the subjects pass; discriminating power is given by the 
Jation is specified by the probit 


regression equation; chi square provides an objective test of whether or not the 


item meets the normal ogive assump ion; S 
limen and regression coefficient permits the selection of items comparable in terms 


of ability, difficulty, and discrimination. "Techniques 
of this approach are also outlined and illustrated. 


J. INTRODUCTION 


Classical mental test theory assumes that the abilities underlying perfor- 


mance are continuous and normally distributed variables [19]. It further assumes 
that the probability that a subject will answer an item correctly is a normal ogive 
function of his true ability, i.e. the degree to which he possesses the ability 
underlying test performance [2, 6, 10, 12, 14, 15, 17, 18, 21]. These assumptions 
provide a theoretical basis for an integrated approach to item analysis, in which 
refined estimates of parameters to describe the items can be obtained, and from 


which extensive information can be obtained by the test constructor DN analyst. 
Despite these advantages, currentl s are of an ad hoc nature, 


+ 
y accepted procedure d h 
and when used in combination, lack logical integration An alternative D 
to item analysis, although based on t uses the pro” 


he same assumptions, 

fractile graphical methods to obtain more informative, more accurate, and qu 
integrated estimates of item parameters. Two decades 280 parean [ » 
Lawley [12, 13], and Finney [7] expressed logically the assumptions and rationa 
underlying this approach. Here, their rationale is exte: 


nded to cover more 
Pr i imation 
Problems of item analysis, and emphasis 1s placed upon practical estima 
Procedures. 


X The fundamental princip! 
Sigmoidal response curve into 
response probabilities based on th 


s is to transform an ogive or 
a straight line using à transformation of the 
e normal integral [8]. As pointed out byFinney, 


Fechner origi idea in 1860 while considering weight-dis- 
hought of the idea 1n E $ 

E in psychophysics- The basic terms for the probit analysis of 

items are as follows. Let P refer to the proportion of testees passing an item 


and X to a measure of ability, usually the total test score OF criterion score. 
Then the probit Y is the unit normal deviate corresponding to P, plus 5, and is 


e of probit analyst! 
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therefore linearly related to ability, X, by the equation, a 
Y=5+ E (X -)), 


x d n 
viation and mea 
where c and p are the parameter values of the standard deviati 


i the 
: f ‘13 ation for 
respectively. This equation will be recognized as the familiar equ 
linear transformation of test scores, 


S Q) 
Z=K+ zn) 


è : tion, and 
where K=5 and S—1. Equation (1) is the probit regression equatio 
b —i[c is the probit regression coefficient. 


Building upon these conce pron 

is possible which provides answers to the following five questions: 
G) How difficult are the items? ful subjects? 
(ii) Do the items distinguish between successful and unsuccesstu 
(iii) In what way are the items 
(iv) Which items in the test ar 


(v) How can two tests be 
different items? 


related to overall performance? 
e best? 


^ t have 
Set up which are comparable in all ways bu 


: e : MO referring 

gnized in the context of * item analysis ek ability 

respectively to (i) item dificul ii) item discrimination, (iii) ite ach 
P ty, E 


m may be giy 
and hence the value of X 


hich gives the probit y—5 [7]. The sample 
for an item will be referre 


d the 
nd Lawley [12] also propos" -yt 


. d 10D, 
S Measures of discriminat 


ility i i the P 
regression equation (see Figure 1, p. 56). ability is described by 
It is desirable to have some method E 
of tbe ylis oora by the above proc In the present context, the z 
arises in measuring the trend of item performance in relation to ability: . , 
graphical technique developed by Mahalanobis [16] is appropriate for estim? 


ent 
: n rem! 
for estimating the error of measu 
edures, 


; analysis 
pts, an integrated approach to item i 


2 


EM 
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e 1 . B 

E in the measurement of trends. This technique, known as ‘ fractile graphical 

s ysis’, involves a visual comparison of trends observed in two independent 
samples of an original sample. This technique provides a visual estimate of 


the " OW 29. á 
error of measurement arising 1n determining the relation. between item 


performance and ability and hence also for the associated difficulty and discrim- 


ination measures [3]. 
T hs may now be asked whether this approach to item analysis can provide 
n objective criterion for item selection. According to the initially stated assump- 
tions, the probability that a subject will answer an item correctly is a normal 
ogive function of his true ability. As ability is inferred from test score, and as 
test score is assumed to regress linearly upon ability [19], then this probability 
should be a normal ogive function of test score. To test whether items satisfy 
Es assumption, a test of the ** goodness of fit " of the probit line can be employed. 
inney [8] has outlined the procedure for testing the significance of the dis- 
crepancy between the frequencies expected in terms of theory (the probit line) 
and the observed frequencies using the chi square test. The hypothesis of 
good fit" is accepted if chi square is not significant, and is rejected if chi 
Square is significant. Only those items for which the chi square test is not 
Significant would be acceptable in terms of the original assumption. Since 


inferences about the test and individual performance are usually made on the basis 
of classical mental test theory, the items comprising the test must satisfy that 
theory’s assumptions. The chi-square test provides the appropriate objective 
criterion. 
A device for choosing items for parallel tests may be suggest 
be item, difficulty, measured by m, and discrimination, mé 
ave been obtained. If the items ar? then plotted with difficulty along the 
rs or triplets of items can 


abscissa a aed NN 
nd discriminating power aS } Moet 
be picked out which are matched in te ly of difficulty and e i 
but also of ability, because difficulty is given 1n ability values along t e 
abscissa, "This device integrates the estimates of d! 
al of an item with the ability required to deal wit 

ons of classical mental test theory 
F ; bove 
Cur ovide answers to some of the a 

rently accepted procedures pr Probably uc most 


questi. is indi ; d discr: 3 
ons by using indices of difficulty an soul sing the item; 
i success with 


widely adopted index of difficulty is the PTO S 
popular indices of discrimination include the correlations of item guns 
Criterion performance, and the comparison of the ORNA a can 
testees in high and low criterion groups ,5,10, 11]. Ji al aa 9 1 tial 
taken as the index of item diffi "c is seen that it provides on y pe 
answer to question (i) as it does j lation between : culty A 

Overall test performance or ability, and also 25 it is specific to the SU ject popula- 
tion, rather than to the test itself. Similarly; correlational and comparative 
indices of discrimination do not permit estimation of performance at various 
ability levels, and therefore do not completely answer question (ii). It follows 
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i i ability is 
tion (iii) concerning the relation between item success u kw is 
that om RE answered by these particular indices. cua diis IRR 
moire jective criteria for item selection base 
i s, as no objective criteria i dw 
See E ORI have been developed for Surumary pru E SENE 
ol i i ed ulliksen, 
estion (v) has been proposed by 1 teri 
A method of answering qu : ; 5r opm 
i f the proportion of people passing i of 
items are plotted in terms o I 1 ] Bad er B 
i lation between item performa : 
lation [11, p. 208]. The re E bane 
ability wt pertinent, is not revealed by this method. These inadeq 
s zs occur when the probit method is used for item analysis. 


II. ESTIMATION PROCEDURES 


- In this section, practical procedures for the estimation of dies M 
ination and the item-ability relation will be outlined and illustrated. t of the 
attention will be paid to the application of punched card peer lan De 
Hollerith or IBM type. Appropriate hand tabulation techniques wi : digital 
described. Since these procedures can also be carried out on eleerronie noite 
computers, additional comment will also be made on the appropriate ha sectibn 
for programming and processing of the data. The topics dealt with in this robits; 
are: (1) obtaining the item frequency tables; (ii) converting frequencies to Pe dont 
(iii) drawing the probit line; and (iv) estimating the probit regression eq 


(i) Obtaining the item frequency tables, 


: asa : " : ls and 
The range of test scores is divided into seven to ten class in reubject® 
for each interval the total number of subjects is obtained. The number of $ 


z : z : : unted. 
in each class interval correctly answering each item is then tabulated or co 
To do this on punched 


re 

card equipment, the item responses and total a 

for each subject are Snc on one card or one set of cards. Item rapon sere 

be punched as given on the answer sheet, or as ‘ right’ or ‘ wrong’. tically 

mark-sensing cards are used as answer sheets, item responses will be automa 

punched by a reproducing punch. The cards for 

deck of cards. Divide the deck of cards into sub-de 
and gang-punch 


an identifying number into the 
electronic statistical machine can then be used to 
for each class interval, and also to punch the ite 


cards (by use of an associated reproducing pun. 


is not available, a counting sorter or ordinary 
the frequencies. 


If hand tabulation is necessary, place the answer sheets into groups accor ges 
to class interval. For each class interval, tabulate the number of right resp 
for each item, also noting the total number of subjects. 

For analysis on an electroni 


S interval 
cks according to class int 


cards of each sub-deck- cies 
tabulate the item fre EA 
m frequencies into peto 
ch). If this type of me iin 
sorter may be used to 9 


ise the 
all the subjects comprise 
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or t 
Eis ss total scores may also be entered along with the item responses. By 
gramming, the computer can be instructed to obtain and store the item 


frequencies in the memory. 


(ii) Converting frequencies to probits. 
A ree frequency right is to be converted to a proportion by dividing it 
" duc: number of subjects in its class interval. Transform the proportions 

probits using probit tables [7, Table I; 9, Table IX]. These computations are 


illustrated in Table I. 


TABLE I. COMPUTATION OF THE PROBIT VALUES FOR ONE ITEM 


‘Test Score Number of Testees Proportion Probit 

Interval Midpoint Total Right Right Right 
(1) (2) (3) (4) (5) (6) 
0-4 2 19 3 0:1579 401 
5-9 7 27 12 0:4444 4:85 
10-14 12 31 25 0-8065 5:88 
15-19 17 19 16 0:8421 5:99 
20-24 22 33 30 0:9091 6:34 
25-29 27 81 79 0:9753 7:05 

30-34 32 27 27 10000 8:09T 


+ 8:09 taken as probit representing unity 


pre If summary cards giving item frequencies 
pu ceding step, computation of proportions can 
nch. Proportions may be transformed to probits by refere 


after tabulation, or by using 2 reproducing punch with a master 
in probits, should be tabulated 


tion- s 

i n-probit cards. Item success, 1n 

SEA Conversion of item freq o be done manual Mi 
f an electronic computer is being used, programming would call for computing 


Proportions and reference to à probit table stored 


o 'The probit line can be drawn from the data in step +: 
= the abscissa, and item success in probits along the ordinate as 
igure 1. One graph should be drawn for ach item. Ploteach Pro pi 
gu mid-point of its test score class inte Following the principle given 
ded [8], draw a straight 
Fi ed points, giving less weight 
dup 1 presents the probit line for the data 1n 
ma more appropriate for electronic computers, 
'aximum likelihood method in the programme WO 
&ve the probit regression equation discussed in the next step. 
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FiGUnE d. Item Success in Probits 


fas it Line 
plotted Against Test Score, giving Probit 
Mean (m) and 


Standard Deviation (+10). 


(iv) Estimating the probit regression equation. ero 

From the probit line, the sample mean, m, and sample standard pog the 
n be obtained. The value of X corresponding to probit 5 gives 1» 
difficulty or limen of the i i 


T 1 1 
Y=54 35%- gs Q0) 
=0-118 X 43.941 


is the probit regression equation for the item plotted in Figure 1. 


Ill. FnacrIE GRAPHICAL ANALYsIS " 
Fractile graphical analysis has been Suggested in the introduction 3$ s 
method for visually estimating error of measurement. As this method may m 
be familiar to psychometric Workers, it will be discussed briefly in terms 
its original purpose, 


I : " 
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Mahal i ; a 

e derro peet eloped fractile graphical analysis as a method for examini 

original pie Near čstimating trends found in sample surveys [16]. In AS 

fi seas , two interpenetrating subsamples are drawn n d me 
ent from the original sample. Members of each Sende a 


placed in deci 
eci i i 
tie anno = some other fractile) groups on the abscissa. For each grou 
ian ordinate value is obtained, and these ordinate values ee 
tely. This procedure 


plotted a 

3: alee = — for each of the subsamples separa 

ills oF vie al combined sample. The latter line gives the sample 
rend, while the area between the lines of the two subsamples 


iv j 
8 EU eie estimate of the error. x 
samples are desi, e the procedure may be somewhat modified. Two sub- 
Steps ii and iii ab om the set of answer sheets (or cards) and the operations in 
two subsample ove are carried out (see Table II). The probit values for the 
The probit P » are connected and the area between the resulting lines shaded. 
values for the combined sample are also connected (see Figure 2). 


The 

second li iv 

shaded ee gives the observed values used for the probit analysis, while the 
gives a visual estimate of the error associated with the observed 


8. 
un 

g| ee 2 
& =, COM 
z 
5B oel 
La 
e 
C 
ae l 
Uu) 2 
S ij f 
E f 
7 o L A RE 

1 1 1 
2 7 12 17 22 27 32 
TEST SCORE 
t Score for Two 


Ficu ; 
RE 2, Fractile Graphical Analysis of Item Success in Relation to Tes 
) and Combined Sample (Com). 


Subsamples (SS1 & S92 
or different ite 


on of the graphs f 
he size of the error area. 


Jationship 
This method mig! 


and validit 


ms will, in practice, 
Greater confidence 
success and ability 
ht be employed in the 


val 

teal pore: Comparis 

can be aap variation in t 

When ds pe in the observed re 

examination ar area is relatively small. 5 

item anal n and presentation of reliability 
ysis data as outlined here (3, 4- 
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: 
IV. A CRITERION For Trem SELECTION 


An objectiv itefi : 

re cem criterion for item selection has been proposed which can 

EE IDs s zs items have been analyzed according to the procedure outlined 

cormel ogie wen ie whether the item satisfies the assumption of a 

ae a : m probability of item success and test score. Chi 

ce rares oats he objective statistical criterion. Those items for which 
significant would be rejected and those for which it is not significant 


would be selected. 


T : Y 
he appropriate computational ble III and are 


steps are presented in Ta 


TABLE III. COMPUTATION or CHI SQUARE FOR One ITEM 


Total Number Right 
(r-nP) 


ES ov 1 Expected 
idpoint a P n Observed Expected Discrepancy 
(1 r nP r—nP nP- P. 
6 a ay O CORN @ (8) ©) : 
pr 447; 02061 19 3 3:92 0:92 0272 
10-14 K 4767 04090 27 12 — 1104 0:96 0:141 
15-19 x 5:357 0:6406 31 95 1986 514 3701 
20-24 u 5.947 08289 19 16 1575 0:25 0:023 
25-29 E 6.537 09382 33 30 3096 —0:96 0-482 
30-34 7 7127 09834 81 79 79:66 Eyga a 0822. 
32 7717 09967 27 27 26:91 0-09 0-091 
peur 


chi square — 5:039 


e followed manually, on punched card 


bri 

ae explained below [8]. They may b 
pment, or on an electronic computer. 

Ns bos the expected probit value for each class interval using the 

fist c ession equation (1). The value of X to be substituted in the equation 
s rs -point of the respective class interval. 

Brobit GET the expected probit values to 

e [8, 9]. 

3. Determine t 


proportions reading from the 
lass interval by 


he expected frequencies, nP, for each € 
ortion, 


f subjects in it, n, by the expected prop 
col. 4, nin col. 5, and nP in col. 7. 
frequency np from the observed 
1. 7 gives nP, and col. 8 gives r—nP. 

h class interval. For Table III this is 


frequency right, 


i square with 


T 
he sum of these values for all : 1 vil 
s intervals or ability 


k= 
2 degrees of freedom, where k is th 
in Table III, chi square — 5:039 with 


gro > n * 
ups. For the illustrative example 
ich is not § nificant thus permitting 


5 d 
E. n of freedom, whic 
ptance of the normal ogive assumption. 


tatistically sig 
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i i Of the 
ives chi square values for 33 items of a 40 item test. rt 

33 tcn is e Bant for 14, and not significant for i n d 
19. 'Those items remaining would thus be selected. It will be v «om 
items in Table IV remain unaccounted for. No probit line ks colere 
visually to those items which would give estimates of difficulty and 1 a te 
because the proportion of success was equal at all levels of abi ri 
in a horizontal probit line. These items were automatically rejected. 


ST 
TABLE IV. Sratistics FOR SELECTING AND ORDERING IrEMs or a 40 Irem TE 
(based on 237 subjects) 


Item Mean Standard Probit Regression Chi square} 
Number Deviation Equation 
)  Q) 6). (4) 6) 

2 800 1600 Y —0-062 X + 4-500 13:3661 
2 1600 745 Y—0-129X 12:935 8:726 
3 1300 15090 Y —0-067X +4133 11:2961 
4 - 1600 — 800 Y—0425X.4-3-000 15-0931 
5 1600 1200 Y —0-080.X + 3-720 13-675} 
6 — 27.00 7-50 ` ¥=0-133¥+41-400 2:566 
7 2300 1700 Y —0-059 X + 3-647 11:979} 
9 1400 9-00 Y-0-11X-L3-444 18-0998 

10 9-00 9-00 ¥=0-111X + 4-000 5:039 

12 800 — 10:00 Y=0-100X+4-200 5:479 

13 1100 1000 Y —0-100X +3-900 4274 

14 14-00 7-00 Y=0-143X + 3-000 21:159§ 

15 24-00 1290 Y —0-083 X + 3-000 9:847 

16 — 2000 9:50 Y=0-105X+42-895 10-802 

17 1400 745 Y—0-29X 43-194 11:515} 

18 1090 6:50 Y=0:154X 4 3-462 5:227 

20 1100 1000 Y —0-100X 43-900 16:4358 

21 16.00 5-50 Y —0482X 4.091 4:391 

22 1600 1490 Y—0071X 43-857 12-1614 

23 2490 9:75 Y —0-103 X 12.538 23-383§ 

24 — 1300 1000 Y —0-100X 13-700 3:676 

25 1200 1025 Y —0-098X + 3.399 9:426 

26 2100 7-00 Y —0-143 X 12.000 5:707 

27 1400 6:50 Y—0154X 12.846 5:763 

29 18-00 8-00 Y¥=0-125X 42-750 4:237 

30 13.00 9-00 Y¥=0-111X 43-556 4-339 

31 1700 875 Y¥=0114X 43.057 14-658 

32 15-00 1599 Y —0:067 X 4.000 87-0468 

33 17-00 12-00 Y-0:083 x. 3:583 5-445 

35 21-00 9-00 Y¥=0-111X 42-667 1:552 

36 20:00 725 Y=0-138X+ 2-241 3-816 

37 2000 7:50 Y —0-133 X 42.333 31:4578 

40 — 2200 11:50 Y=0-087X + 3-087 3-419 


T 5 degrees of freedom, $P<0-05, $P «0-01. 
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V. A Cart For PARALLEL TESTS 


een to pick out items for parallel tests, it would be desirable to select 
ability b diy not only of difficulty and discrimination but also of level of 
nnl X is may be accomplished by plotting items on a chart with difficulty 
guten ES m,in ability values, and discrimination as the regression coefficient, 
Vignte A 1 an ine ien the 19 items selected from Table IV have been plotted in 
7i ria ifficulty values are taken from col. (2) of Table IV, and discrimina- 

rom the first element of the regression equation in col. (4). From Figure 3, 


‘07 Kae, 
8 22 26 30 


m 


Items in Terms of Mean (m) and 


F , 
IGURE 3. Item Selecting Chart for Matching 
Regression (b). 


it should be possible to pick out pairs or triplets of items, depending on whether 
two or three parallel tests are desired. This procedure would assure the test 
Constructor that sets of items pi f the limen and regression 
coefficient would be comparable and also t item success in probits 
would be linearly related to ability. - 1 
This chart could also be used to order items wit l 
tion. By picking out items from left 


ability level, difficulty and discrimina 
to right in Figure 3, the 19 items accepted from Table IV can be rearranged 
k difficult and discriminating to most difficult 
9, 16, 36, 35, 26, 


in the following order, from least 
and discriminating: 12, 10, 18, 13, 25, 24, 30, 27, 2, 21, 33, 2 
40, 15, and 6. 


cked out in terms © 
hat for all items, 


hin a test in terms of 
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VI. Some EMPIRICAL OBSERVATIONS 


Two questions may be asked about the actual computations. qe pron 
analysis: (i) how reliable is the visually fitted probit line? and (ii), is the ut 
line affected by the choice of ability groups? "These two questions 
investigated empirically. The data obtained are summarized below. -—. 

Reliability was examined by having the entire set of doom a 
the test analysis reported in Table IV carried out independently by two di wt 
persons. To test whether the two sets of probit lines were giving d 1 
estimates, the limen values were correlated. For the 33 items of Table n. 
product moment correlation of 0-96 was obtained between the two sets of li 


z : P the 
values. This result lends confidence to the use of estimates obtained from 
visually fitted probit line. 


s their 
; the two sets of class intervals and 


: : . 3 ere 
respective frequencies are Even in Table V. For the second set, intervals W 


TABLE V. Frequency DISTRIBUTIONS ror Two SETS or Crass INTERVALS 


Set 1 Set 2 

Class Class 
E n Intervals n 
(2) (3) (4) 
0-4 19 0-6 35 
5-9 27 7-11 29 
10-14 31 12-17 27 
15-19 19 18-23 27 
20-24 33 24-25 27 
25-29 81 26-27 29 
30-34 27 28-29 36 
30-33 27 


y » and the value of t obtaj d not to be 
NL Fm M COE ur di a M M MN difference 
of 1 between the two lime. iven in Figure 4. It may be noted that 
even though the frequency : y 


distribution for the first set of class i ls is highly 
ass intervals 1S 
skewed (see col. 2 of Table V), the estimates obtained by the two methods do 
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not differ signi i iri 
is a nel This empirical comparison suggests that the probit line 
red rable extent, independent of the basis for selecting class interval 
, frequency and range of ability within groups. 
8 
p 
L = saa x EQUAL FREQUENCIES 
g & e—o EQUAL SCORE INTE RVALS x 29. 
= 
$4 
ul 
Q 
J 
5 
z 
m com 
= 
O 


TEST SCORE 


Means Comparing Ability Groups Set Up With Equal 


F 
IGURE 4, Probit Lines and 
qual Score Intervals (mO). 
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PROMAX:A QUICK METHOD FOR ROTATION TO 
OBLIQUE SIMPLE STRUCTURE 


By Avan E. HENDRICKSON and PauL OwEN WHITE 


Institute of Psychiatry, University of London 


A 3 ; F 3 ; 

orilo new method for analytical rotation to oblique simple structure 1s described. 

Tek goan simple structure is achieved by means ofany of several existing rotation 
ods and this is then transformed into an oblique solution. 


I. INTRODUCTION 

s have been made to develop methods 
ple structure (see Warburton, 1963). 
re recent work of Kaiser and 
these methods have become 
ical solutions more 
f increasing com- 
s often beyond 


tsy rii - recent years, numerous attempt 
Ecom dhe Clun determination of oblique sim 
Dicen an attempt by Carroll (1953) to the mo: 
S crim 9) with their Binormamin criterion, 
lonely paese in that they approximate ideal graph 
an ee his success, however, has been won at the price of 11 
in time to the point where the desired oblique solution 1: 
eans of a research worker. 

eco dis describes a general method for quick rotation to oblique simple 
ich a ae Ithough all the computations have been carried out with the aid of a 
oss 5 computer, the solutions could easily have been obtained by hand 
the ation. Furthermore, for the particular data that have been considered, 

results appear to be at least as good as those obtained by any existing analytic 


methods. 


II. RATIONALE 
have been iterative procedures that 
ughout the computations. 
h a new criterion, it was 
* ideal ” oblique solution 


NE xum oblique analytic methods hay 
We axed the restriction to orthogonality thro 
dosi cioe attack the problem in this fashion with. 

fr ed to use an orthogonal method first, construct an 
om the results of the orthogonal rotation, and then rotate the orthogonal results 
nown and readily 


to a least squares fit to this ideal solution. The now very well k 
6, 1958) was used as the orthogonal 


avai i : 
Vailable Varimax method of Kaiser (1956, e 3 
Criterion, This choice was dictated by two major considerations; firstly, Varimax 
re relatively fast as an iterative method, and secondly, the results which Varimax 
ypically gives were well known. 
F THE IDEAL SoLUTION 

_ Starting with a matrix of factor loadings that has been rotated to orthogonal 
simple structure, the problem was to construct an ideal, or “ pattern ? matrix 
as a function of the orthogonal solution. Perhaps the most simple pattern matrix 

S.P. 5 


III. THE CONSTRUCTION © 
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is generated by inserting + 1-0 for salient factor loadings and putting 0’s else- 
where. . : 

However, whenever the least squares fit of the orthogonal solution to this 
simple pattern matrix was computed the result seldom seemed satisfactory. 
The solution obtained from such a procedure, though commonly quite oblique, 
was very far from what most people would call simple structure. The trouble 
seemed to lie in the definition of ‘salient’. For example, a cut-off point of 
0-20 or above will usually put far too many 1’s in the matrix and a cut-off point 
as high as 0-50 resulted in variables with loadings of 0-49 not being given sufficient 
weight. 3 

There was a need for differential weighting of the variables, and the logical 
conclusion of this line of argument is to have an infinite set of weights corres” 
ponding to an infinite number of possible loadings. Now the problem was to 
find a set of weights which would correspond to our intuitive idea of how much 
weight should be given to a given factor loading. The accepted ideal solution 1$ 
that high loadings should be increased while low loadings should be made 
smaller; weights for high loadings should therefore be proportionately larger 
than those given low loadings. A family of sets that meet this intuitive notior. 
of greater proportionate weights for high loadings are those sets that consist © 
powers greater than 1 of the corresponding loadings. It was therefore propose 1 
to generate a matrix wherein each element would be a function of the orthogon? 
loading, the length of the test vector, and the length of the factor vector. 

We define a matrix P=(p4), such that: 


; bu- | ai | lay, a 
with k>1. Each element of this matrix is, except for sign which remains U^" 
changed, the kth power of the corresponding element in the row-column normal ; 
ized orthogonal matrix. Then find the least squares fit of the orthogonal matrix 
of factor loadings to the pattern matrix generated by equation (1): 


L-(F'Fy3F'P, Q 

Ms E ee Ue transformation matrix of the reference ip 
re 3 3 

> F is the orthogonal rotated matrix, and P is the matrix derived from 


the orthogonal matrix defined in eqn. (1 à ven i “ ustes 
equation recently described b aA his equation i tke." ror 


; y Hurley and Cattell (1962). The columns ° 
are normalized such that their sums of squares are ae ies. This provides 


the transformation matrix from th nce 
: € orthogonal fact lique refere 
vectors. From this point standard and : of to the oblia 0 


) 
well-known formulae (Harman, 
can be used to compute the intercorrelati i factor? 
: at : ac 
and the matrix of primary factor fhe. a a pre 
The function (1) Y 


was selected as a means of i i io of high 9 
i : s of tio 0 
low loadings in the ‘ pattern’ creasing the ta 


E > matrix P, t i 4 smaller 
loadings into the hyperplane wi hus in effect forcing the 


thout having t i itrari inspection 
on a cut-off point between the high loadin g to decide arbitrarily by insP pet" 


a NN s or salients and the low or ‘ PY 
plane’ loadings. It was hoped that the Elo d Sud a sufficiently 


P : DL 
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o that successive powering of the Varimax 


loadin : 
A Sage force the relatively low loadings into the hyperplane, thus yielding 
matrix P towards which the Procrustes procedure indicated in 


eqn. (2 

ee rotate the orthogonal solution. For 4 given matrix of 

actor loadings, normalized by rows and by columns, eqn. (1) yields 
f which might be 


a whol ; 3 
tie T e of matrices P, one for each value of k, any one o 
e Procrustes rotation in eqn. (2). The name PROMAX is suggested 


for th P 
e technique and the class of solutions suggested in this paper. 


cl i 
ose to the desired oblique solution $ 


IV. CHOICE OF ^ POWER 
ven to k. This is 


The : a 
E und now arises as to what value should be gi 
o the problem of deciding on a value for the weighting parameter in 


Carroll imi o 
Ils Oblimin solution. 
TION OF HOLZINGER AND 


wirH VISUAL SoLU 
‘Tests 


TABL 
EI. 
COMPARISON OF PROMAX SoLuTION 
HARMAN FOR THE 'TweNTY-FOUR PsyCHOLOGICAL 
rn Matrices * 


Primary Factor Patte 
Promax Solution k= 4 


Tes 

a Holzinger and Harman 
02 70 —07 09 04 75 07 A 
03 46 —02 zii 02 TEM E RE 
04 60 02. 089 0d 63 resp ME 
05 58 07 00 —05 61 07 x 20 
06 —04 83 09  —06 -01 e COSS) 
07 —04 83 —08 09 ot a ine o7 
08 —05 93 04 —12 —02 91 05 —13 
09 22 52 16  -—08 25 50 05 Ei 
10 —08 90 —20 16 —01 87 -17 13 
1 -32 08 78 08 =32 07 80 11 
12 -18 07 61 24 —15 04 62 25 
13 14 —15 79 E12 13 —15 77 —10 
14 35 01 (44  —2 34 02 61 —20 
15 -24 18 01 58 333 14 05 54 
16 Uf 0372 eld. 61 02 Q0 -07 56 
17 ai, 080 07 47 NET d 4 
18 s 04 01 76 -14 01 05 72 
19 "e ape 13 59 gi een dE 54 
2 os 02 03 42 16: 700 02 38 
" 37 25 —05 17 43 24 -05 12 
m 32. -0l 32 13 3 %3 31 11 
z 26 28 —15 34 34 235  -45 29 
A 49 21 08 08 54 20 06 04 
a —01 27 39 18 02 24 38 21 

Primary Factor Correlations 
100 100 
58 100 53 TOA 
0 5 
B Si ki 100 ss 30 9 100 


* Decimal Points Omitted 
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In the absence of any clear rationale for selecting a Lege eei b 
it was decided to select data with both a known factor structure an o ae 
rotation solution which is generally accepted as adequate and to app rabo 
cedure with several values of k in the hope that an approximation to t i 4 = p 
oblique simple structure would be found. It was argued that d d 
might be necessary to try several values of k before an adequate soluti 
found, this would be an economically feasible procedure. 


x ELL AND 
Taste II. COMPARISON OF PROMAX SOLUTION WITH VISUAL SOLUTION OF CATTEL 
DICKMAN FOR THEIR BALL PROBLEM 


Primary Factor Pattern Matrices * 


Measure Cattell's Visual Solution Promax Solution k=4 08 
01 104 -06 00 02 105 —06 oh 03 
02 Es 2. —03 — 0i OMM Ng NM 
03 1208872319. SB 05 54 e oi 101 
04 05  -05 ol 100 0  -05 " 01 
05 -8&  -10 00 03 em -m X7 "gr 
06 108 -10 =01 0 107 -09 00 o 
07 10 -0 0 02 102 — —03 n 02 
08 e a :J RO NE 
09 9209 03 O 03 93  -03 op 03 
10 -05 102 -03 So Sl 
11 -50 122  -0 =04 -33 "0 -0 Zos 
12 12 83 05  -o 24 T2 oe 
13 0 94 -M 02 19 E UM G 
14 03 —101 05 -0 -12  —90 o 03 
15 o2 a5 wee =08 -02  -13 p =o 
16 15  —29 87 -0 10 -25 Ge ei 
17 -5& -31 64 —O05 -60 -27 2 Dn 
18 -03 00 93 06 —05 01 i 01 
19 -24 28 91 02 -20 26 u 9 
20 -05  -02 01 99 -05  -02 ot 98 
2 -07 00 01 98 -07  -01 us 99 
22 -0 -0 02 100 =02  -03 E 02 
23 —13 05 001  —101 —13 05 o E 
24 =i0n 08 03. —65 =12 07 03 — "10 
25 10 — 39 56 — —09 16 36 3 20 
26 ij 05 Y 86 03 18 05 86 hs 
27 SN Ap d oc 66 37 -09 01 
28 59" 08. Sy Gp 60 08 37 09 
29 -02 13 85 10 00 — 13 AS 3 
30 -60 -08 02 59 =62. -0 01 7 
31 22. TR 00  -43 BUM o3 0 5 
32 08 84 16 31 21 76 17 " 

Primary Factor Correlations * 
100 100 
76 100 68 100 
21 —05 100 20 —10 100 
-11 —06 03 100  —16 00 02 100 


E 3 à 
Decimal points omitted. 


romax: A Quick Method for Rotation to Oblique Simple Structure 69 


Promax w i 
ax was first tried on the now classic data from the Twenty-Four 


Psyc i i 

on in of Holzinger and Harman (1960). 'The results were very 

eene m ith k=4, the results seemed to be better than the already quite 

oe wi pong provided by Kaiser and Dickman (1959) and was indeed 

oe ib er than the subjective visual solution which we regarded as a 
. Table I presents a comparison of the Holzinger and Harman visual 


did n with the Promax solution with & equal to 4. 
Ed run bes. the generality of 4 as an adequate power, we used the same 
Dedans ya data. Table II presents the analysis of Cattell and 
with fie K P ) ball problem. The Promax solution with k=4 was compared ` 
tell’s visual rotation which was based on the Binormamin solution as a 


startin i 
gpoint. It would be superfluous to present the Binormamin solution here 
nce between any one element of 


td LS ases e the maximum differe 

0-04, and vem matrix and the correspon i nt of the Promax matrix Was 

"Ba portus Lim (owed of elements differ by only 0-01 or not at all. The 

eus : rs little rom ours, andin View of the very c 
romax and Binormamin, it seems almost certain that Cattell would have 


'HURSTONE'S SoLUTION TO HIS Box PROBLEM AND PROMAX 


wirg k=2 
Primary Factor Pattern Ma 


Aw 
‘ABLE III, Comparison oF T 


trices * 


Measure "Thurstone's Solution Promax Solution k=2 
01 100 00 00 101 2 02 OS 
02 03 99 01 oo 100 00 
03 01 02 98 E poo o 
04 49 76 00 47 76 03 
05 40 01 87 "ed 87 
06 01 41 82 —05 38 83 
97 74 54 03 a g 
08 87 02 40 87 -02 37 
09 —01 80 46 —06 79 46 
ie 63 66  —01 62 és 0 
i 69 01 66 Me 
12 —01 64 65 —06 62 66 
13 98 o4  —01 100 o  -—06 
14 -02 97 06 —06 98 06 
15 0  -02 96 Toz —07 99 
16 29 38 7 24 34 73 
17 66 48 28 64 46 26 
18 97 —03 01 99  —06 —03 
19 07 95  -04 05 96  -—05 
20 00 03 98 05 ee oe 100 
Primary Factor Correlations * 
100 100 
23 100 29 100 
101022208100 22 29 100 
* Decimal Points Omitted. 
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; T 
ed from the Promax solution. ; It is o 
a ie ining A TN AN the visual rotation improved 
Eee one factor. te 
the SEGUE Abeer Thorton’ (1947) solution » m Box eye 
i i —2. The powers higher than pro tod 
SA Mu e E d shared the same defect; i.e. they d ds 
obli s However, the Promax solution shown seems to be almost as oe ph 
mem cuni provided by Thurstone, Although neon ys 
(3: 0:01) is identical to that of Thurstone's visual solution, the la - onlusu Wee 
just slightly ‘ cleaner’ than the analytic solution. The Promax u——9—. 
k=3 is virtually identical to the Binormamin solution; the se sina da oe 
between any two corresponding elements of the matrices being less 
the majority being identical to two decimal places. 


as 
romax h 
In addition to the three textbook examples presented here, P 

since been tried on man 


he 

y sets of data from studies currently in idee. 

general conclusion to be drawn is that for the majority of cases, the opti ticularly 
for k is 4; however, for the occasional factor analysis where the data Is pa 
“cleanly ' structured, a lower power seems to provide the best solution. 
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NOTES AND CORRESPONDENCE 
WHAT IS CONSCIOUSNESS? 
By J. G. TAYLOR 


T VE Burt's plea (this Journal, XIV, 145-170) for the restoration of the concept 
dis to psychology calls for a vigorous reply. If he had pleaded for a resumption of 
systematic study of conscious phenomena, without prejudice to the scientific search for 
oval, But that is not what 


ig ah to explain them, he would have met with general appr 
asks for. His contention is that to account for the phenomena of consciousness it is 


aes to postulate an immaterial ' mind’ that js independent of the body and has 

eco GUMDUE properties, of which the most distinctive isa capacity for conscious- 

SHAG cay ts narrower sense of the term, i.e» for cognitive awareness . Itis this capacity 

m akes the postulated mind distinctively ‘ psychic’, i.e immaterial. Cognitive 
reness is further described as " a simple and unana 


ipi lysable dyadic ‘relation ' " between 
am mind’ and some object, which need not be material, since there can be awareness of 
one's own conscious states. 


If we accept this notion, it is clear that we are committing 1 
severe restraint on the scope of scientific enquiry. Tf we say that consciousness is the 
onsciousness, We are saying nothing of any 


product of something that has a capacity for € 
moment; but at least it is implied that there is something to look for, something whose 
properties may explain the capacity in question. But if we say that this something is 
psychic or immaterial we are locking the laboratory door and throwing away the key. 
For who can search for something that has no material existence? In what follows I 
Propose to show that awareness of even su! imple thing as the position of 
a material object is neither simple nor unanalysable, th: ept of ' mind > js un- 
necessary for its explanation and is indeed incapable of explaining it, but that it can, on the 
contrary, be fully accounted for in behavioural terms. pi 
Consider my awareness of the unchanging position of the ink bottle on my writing desk. 
As Henri Poincaré pointed out 60 years ago, in La Science et Phypothese, the only real sense 
the same bodily movement 


in which this position may be said to be unchanging is that 5 Pere 
always serves to establish contact with it. ‘That is, as long as I remain seated, with my bac 
f the ink bottle, referred to à frame o! 

are invariant. 


resting on the back of the chair, the coordinates ©} 

reference anchored in my body with the origin in, say, the atlas vertebra, t 

But these coordinates are not directly represented and there is 

therefore no obviously simple way of accounting perceived pu 
Apparently the only afferents from which the position of the bottle can be enyen are 

those depending on the coordinates of its images © i But these coor e 

are constantly changing with movements of the eyes and head, so that fhey alone canno 

in coordinate geometry. 


yield the invariant position. c 
Beometrician, if given the coordi f the retinal images at any mome 
compute the coordinates of the object o 
require to know in addition (a) the coordinates of my €i 
when my head is in a standard position, (b) the lateral displacemen 
the median plane of my head, (c) the vertical displacement of my eyes 3 à quu 
plane through my head, and (d)a transformation specifying the comer 7 Eo ue 
head relative to the bodily coordinate system: The information um EN t , £ 
parameters of the system, while (b), (c) and (d) are variables. Armed wit 
“ion of the ink bottle, and he will return the same 


the geometrici the positio 

trician can compute P x E x E 
answer no matter what values are assigned to variables (b), ©) and (d), since bs in P 
junction with the position of the object; determine the coordinates of the retinal images. 


ourselves in advance to 2 
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All this information is required for an exact solution, and if one or other of the eris 
values is not disclosed, the geometrician can only specify a region within which the ol i e 
isto be found. Within that region its position is indeterminate. Now if my duae 
the position of the bottle is an act of an immaterial * mind >, itis evident that it must n d 
all the information that the geometrician requires, or at least physiological analogues d as 
information, since the perceived position of the bottle remains extraordinarily pes Her 
long as I am in good health and wide awake. It is obviously required in any case, W ne xi 
there is a * mind’ or not. I shall later show how it is utilised by an organism that has ix 
‘mind’; but for the moment I am concerned with the implications of this requirement 
Professor Burt's theory. dit 

The geometrician gets his information in numerical form and he can feed the ue 
into a digital computer and get the answer in a very short time. But the data on which t 
“mind ’ has to operate are in the form of analogues of the numerical data, and very inn 
analogues too, according to neurological findings, since many hundreds or even thousan- ; 
of neurons are involved in representing any one value of each variable, and two values re 
excite many neurons in common. The computational task which the ‘ mind ' has to un e 
one, as it is required to arrive at the answer in a fracti an 
once in a second. And because it is, ex feet o 
yy it process this complicated mass of data without bene sak 
the hardware built into a material computer, But that is not all. It is not only the 2d 
ion in my awareness. 'lhere are other objects 1n 5 
ctive and fixed Position, and I am simultaneously ne: is 
5 4 tant. If there is a ‘ mind’ that is responsible for all E x 
its task 1s not merely formidable, it is forbidding. The onus is on Professor Burt to $ a 
how it is accomplished; and he must note that there is no afferent representation of a 
Tuis ica ii E must show how the “ mind ’ acquires its knowledge of these paramete 

A A ai question, and science will not be content with a vague answer to it. eval 
theories nthe feld are co i ana O nore these dieutes while the only rio 
diverting his readers’ Homie LE, Hin veis Ee snore a med theory: 

oreover, he blinds hima? : om the much more serious deficiencies of his ov 
o 
that the rel 


sons of 

€ this last pri iti i joc e implications 9 

sor Burt's further Statemen ind TDi daga, vede field analogous 

Point a field force has both magnitude kis 

one magnitude and one direction. Sup le 
onscious experience of normal healthy do 

entific curiosity is never content to accept t g 
hole truth about them. It insists on pecri? 

nd the most powerful instrument for this purpose is the experiment 
Eases to be’ the independent variables. Most of t 
the truth is revealed as an accidental by-product ° 


At any 
t there is but 


tion. But sci 


guesses are wrong, 
experimentation, 


š 


—— o ÓSSBÓ 
A 
eee’ 
eee 
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The change is alway: 1 
pones o 2 j padusa but in one type of experiment there is a sudden switching 
that-«periods of veridical ucture to the true structure, and the gradualness takes the form 
when theisubject en ical perception increase in frequency and duration. 'This happens 
ordering of the e spectacles in the form of total reflecting prisms, which reverse the 
Eis gh amd left m image along any axis we may choose. If we choose the horizontal 
BINOS uta uis. 4: in reverse, but after several days during which the spectacles 
report a brief period z 2 east for a substantial portion of each day, the subject may 
Ses thebthe Rel Eas veridical perception. If we adopt Professor Burt's theory we might 
becomes more: fr as been reversed in sign along one of its dimensions, and that this reversal 
ec e penal — until finally it maintains the new direction continuously. The 
"There ^ E speak, restructured itself. 
‘lear fel A Dvieyen a very tormidable obstacle to this interpretation. To make this 
Bonddermunu m to adopt an arbitrary definition in terms of Professor Burt's theory. 
objective and = er of points, A, B, C.-- Y, Z, strung along a horizontal line in both 
o2 We EU Deed space, such that A is to the right of B, B to the right of C, and so 
delved orderings Lai points B being an ordered series. Now assuming that this per- 
say thatthe det of US work ofa mind having the properties of a field, we may presumably 
that the field ét objective points Is mapped into the space 1n which the field operates, and 
that rengths at these points are o; By de Our arbitrary definition states 
a<ß<y<. < yo; 
and 
eee rica that the perceived right-left ordering is simply and unanalysably derived 
IPths vertes of the series a to w. . bu 
Ripped ia di ject puts on spectacles that reverse right and left the objective set of points is 
n the reverse order into the space of the mental field, so that point A encounters à 
But by definition w> yx? 


field fi A 
orce of w instead of «, B gets Y% instead of B, and so on. 
perceived inreverse. Next, 


o> T A 
P> a, and therefore by hypothesis the external scene 1S 
vearing of the spectacles, we may postulate that the 


t 
rectis i the results of prolonged w 
Potential : as some mystical alchemy whose nature I shall not try to guess, gets its 
onore p ient reversed along one of its dimensions. At first it cannot hold this reversal 
endurin an a second or two at a time, but gradually it gets established as part of the 
Space "pe structure of the ‘ mind’. The mapping of the objective points into the mental 
Ais reversed as before, but now w < Y< «X: «f «a; and consequently by hypothesis 
perceived as being to the right of B, and so on. Veridical perception 1s restored. 
i ts with right-left 


ee are now ready to intro In two experimen! 
sing spectacles performed in Innsbruck under the direction of Professor Erismann 


a 

qu pd Ivo Kohler both subjects reported that after veridical perception of the spatial 
in SEV of the environment had been stabilised, printed matter continued to be perceived 
Thus a ae ees when the spaces containing the print were seen In their correct places. 
D uilding on the right hand side of the street was seen 1n that position, and its various 
Ben bue seen in their correct relations to one another, but an inscription on a wall u 
iita mirrored. But this implies that the field has suffered a local and limited change 0! 
smio E. such that in place of a smooth gradient of potential we have a gradient that goes 
si othly for a bit, then leaps to a markedly different level, continues with a slope of reverse 
gn, and after another violent leap resumes the original course of the curve. 


Instead o! 
pela >y>S>e>E>7q we have something like x> Bry< S<e>l>m and the interval 
slo ween f and € is exactly the same in both cases, implying that there is a sharp. change in 
pe from £ to y and again from e to 5 One portion of the field has reverted to its original 
Structure, while the rest retains the new structure. I must leave it to Professor Burt to tell 
EA What sort of a field is capable of changing its spots in this odd fashion. And here I must 
mind him of his contention that the structure of the field is entirely independent of the 


Objects or existents that are controlled by it. He is thus precluded by his own dogma from 


duce the obstacle. 
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postulating that printed matter causes the field to alter its structure. Indeed he is pres 
cluded from accepting my suggestion that the field can alter its own structure by reversing 
the sign of the gradient along one of its dimensions. According to his theory the reported 
righting of the reversed perceptual field is an impossibility. 

I now propose to use Occam's razor to lop off the ens called * mind’ on the ground that 
it is not necessary for the explanation of consciousness. This will take the form of a 
demonstration that the phenomena of consciousness can be exactly accounted for in terms 


of concepts that form part of the currency of natural scientific discourse. For this purpose 
let us go back to the ink bottle on my desk. 


> nceived as having no fewer than eleven dimensions: 

$ E Beno pele Patterns of stimulation involving the ink bottle is colossal; but 
oted that its position is fixed, so that there are only eight degrees of freedom 

In other words, the patterns involving the bottle may be said to 
€ of the 11-dimensional afferent space. . his 

ber of 5-dimensional subspaces, each associato 
d. As soon as a point in one of these 5-space 

s contact with the object, stimulus generalization 
pace will suffice to evoke the same response. 


ary by increasing mobility are too complex t9 


of those skills. It is tru 
engrams, but his failure Sprang from tw. 
are thousands or even millions of en T: 
same way, so that the destruction 3 
reached. And secondly, he did n 
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e number of learned responses, although only one of 
To give this state of multiple simultaneous 
The full definition will be 


pools readiness for a larg 
en be executed at any moment of time. 
eae T a precise definition would require too much space. 
my book. 
age posue that this state of simultaneous readiness is identical with visual 
Conidiomsnes e rem ordering of the environment, that is to say, with a limited aspect of 
cae s. here are other sectors of behaviour, directed. to other aspects of the 
kaneloni nt, and readinesses for those forms of behaviour constitute other dimensions of 
E dil PAE i The state of readiness is defined without any reference to consciousness, 
E o s E used are fully acceptable to the other biological sciences. Nevertheless 
ra SSH e to deduce from the definition all the properties of the visual perception of 
Lino! melding the constancies and their limitations, what Professor Gibson calls the 
the Ben dus, died of the visual world, the geometric illusions, and many more. E far 
ing the lic as been worked out in detail only within the realm obe Ud DR 
field of co eption of colour; but I am convinced that it is gener y applicable to the w ole 
` nsciousness. 
fot z Dn to emphasize that my theory is not à variant of the double aspect theory. Jh 
Sume js at consciousness and multiple simultaneous readiness are different aspects of the 
US Ing: I say that they are one and the same thing. Nor has the theory anything in 
d mon with epiphenomenalism, according to which consciousness is a mere surface 
€coration that performs no useful function in the organic economy. If the organism 
Were, like a radar-controlled gun compelled to pursue one line of behaviour to the total 
exclusion of everything else that might conceivably call for action, few animals would 
Survive long enough to reproduce their kind. But when an animal has the capacity for 
pile readiness, alias consciousness, itcan ata moment's notice switch its ongoing activity 
i ala ay and thereby avert disaster or secure some other advantage. e pum 
con readiness, is not a useless decoration but an urgent necessity orany p 
The theory not only accounts for normal consciousness but can also explain fully the 
abnormalities of consciousness that are induced by experimental manipulation of the 
independent variables. But before illustrating this I must explain that the independent 
Variables are not the afferent impulses alone, but those impulses In conjunction ya s 
behaviour that has been conditioned to them. case of the exteroceptors the afferent 
erties of the external environment and the 
f the receptor 


1 m" . H 
MDC are joint functions of certain proP : E 
i ge ee of the receptor organ relative to the body, with the Ed weyere dot 
nd the a idi ameters of the system. 

fferent nerves providing the param ronmental independent 


knowledge 


functions they cannot in themselves yield knowledge of the envi 
nctions are, 


Variables, but if, on the other hand, they were not single-valued functions, Pa 
of the environment would be possible at all. The values of the exteroceptive tu 


i i ssigned 
however, uniquely determined by the environment as soon as specific values aa d. 
x le-valued afferent (proprioceptive) cti 


to the ori Š 3 k H 
rientation variables, and if there are sing? z ‘tioned to 

of the latter, the total afferent pattern is unique and can therefore bS i ed pcaonent 
à response directed to the relevant environmental object, whe um eof the environment. 
he activity of engrams mediating such responses cone us nd of the exteroceptive 
h; It should now be clear that ia tine i art opment and, when action is 
channels, this will result in erroneous o i bjected to 


iately su 
called for, in misdirected responses. are T eee SE ase 
negative reinforcement, and Pe sube We may then predict that 
S ud" adapted to the relevant ee dado. Sledge of the 

e ext is behaviour: errors : 

ey atent eee by true knowledge. Normal perception will be de T os 
the other hand, if there are features of the environment to which no action is directed, 
there is theref *sortunity for the correction. of behavioural errors, erroneous 
s therefor Do E for the persistence of reversed 


Perception of those features will persist. Itis this that accounts 


of the environment. 
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c Y * iments 
perception when the external stimulus takes the form of printed matter, in the experiment 


referred to above. The subjects had first to solve the difficult problem of finding their 


way around easily in a mirrored world before they could devote much energy to reading. 
Actually there is another important fact 


or here, but I shall not take space to discuss it. 

The principles are more clearly illustrated by an experiment in which I MT 
subject, with the collaboration of Professor Kohler. I wore spectacles in the form of ed 
wedge prisms with the bases to the left. One of the immediate effects of those spectac'e 
is that horizontal plane surfaces below the level of the eyes are perceived as sloping dana 
from right to left with an increasing gradient. Two surfaces of this kind were particularly 
important to me, viz. the ground on which I walked and the work table at which I sat. 
Behavioural errors induced by the former included aiming my walking stick, carried in my 

i i actual level of the ground, with pinu 
jolts to my joints, and aiming my (defective) right foot at a point slightly above the grann , 
with a consequent threat to my equilibrium, The errors in response to the work table, 
or the breakfast table, involved a dj 


s. There 
nro veda different motor System, that of the hands and arms. wx 
was no threat to equilibrium, and no responses relative to the gravitational axis nee = 
pare chen: I had to learn to move my hands along a plane surface instead of a curv 
surface. 


; : : eared to slope dow. i from left to right 
Eos he i gradient (a we af Cross M in Suongh the gini at ene 
see s from my feet would have shown Something like a family of exponential pe 
e Constant multiplier in the exponent tending to zero as distance increased), at sde 
as perceived as having a level path about a yard wi d 
- "To the right of this path there was a gentle upwar 


: e 
When I sat at the table its surface appear! 


er 
to that structure. The reese 
ciousness, J saw the table as! ns 
ion relative to the precise positio 


beyond s 
á re my h a 
distorted. ach of my hands, they continued to be seen * 


Since, then, the facts of conscio; 
of the natural Sciences, T maintain 
that cannot be described in n 
to Scientists and philosophers. 


"Sness are exp] 
inc. 
atural d x sc professor Burt Who, by postulating a * minc " 
not to Eu ms, has rejected William of Occam's advic 
» ultiply entia Praeter necessitatem. 
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CONSCIOUSNESS AND SPACE PERCEPTION 
A Reply to Mr. Taylor's Criticisms 


By Cyri Burt 


Th hi 
p rentis “2 pini hich Mr. Taylor has obtained from his ingenious experiments on space 
myself put E highly instructive. Yet I fail to see how they conflict with the theory that I 
rward: indeed, as I shall try to show, they seem rather to confirm it. May I 


how a 
Ti deal first with the basic differences between us? 
D. 229-242) pum paper on ‘ The Concept of Consciousness’ (Brit. J. Psychol., LIII, 
ventured to repeat my plea for resuming the systematic study of consciousness 


as part 
of the task of psychology; and with this Mr. Taylor apparently agrees. The type of 
erimental, but quantitative and 


stud: 
steed Eos was not merely observational or exp 
1 argely a ts 3 I argued that many of the errors of statistical psychologists in the past arose 

n their neglect of the conscious aspects of the processes they investigated and of 


the check 

data. id o could be carried out by using introspection to supplement their numerical 
into ps aylor, on the other hand, maintains that the introduction of statistical methods 
ychology is a mere “ cloak for intellectual sterility” (Brit. J. Psychol., XLIX, 


p. 106 pr ies his critici i 
als a in his latest paper he now carries his criticisms still further. 
e begins with an attack on statements which he supposes I put forward in a recent 


contributi. : . ] 
ribution (this Journal, XIV, pp. 145f.). My contention, so he says, was * that, in order 
it is necessary [his italics] to postulate an 


to 

eee for the phenomena of consciousness, 

E mind that is independent of the body". But may I ask Mr. Taylor to look 
a Convenient article he quotes? There I expressly stated that I “ used the term mind’ as 
and I w nt label to designate the hypothetical basis of consciousness, whatever it may be "; 
went on to insist that “ we should refrain from deciding by definition whether it was 
n parts of the 


or wa H : + H H : 
Was not material, or spatially extended, or even identifiable with certa 
f the mind " (I said) was an issue not to be settled 


br; in?’ 
at ps - “Any detailed description o s 
investi outset, but by deductions step by step from the conclusions reached as our 
estigations advance." 
that the basis of consciousness is what 
me portion of it, 


At the same time it seems clear that, if we hold 


Wo; 1 
uld commonly be classed as a material substance, such as the brain or so 


thi . x ; 
es » in addition to its material properties, that substance must also be endowed with 
ain other properties (namely, a capacity for conscious experiences OF relations) which 

ho had learnt from Dr. 


sed i i E š $ 
not ordinarily regarded as material. Thus, if a behaviourist who ^ à , 
were to open up my brain while I was still 

rocesses anything 


pes Penfield the necessary surgical skills 

Tes Scious, he would fail to discover among the observable structures OF P hi 

embling the sensations, thoughts, or feelings that I actually experienced. Indeed, the 
b denote by the 


Quality of conscious experience is so utterly disparate from the qualities we Cen 
eded, and the most appropriate 1S surely 
jal”. But the 


Word * à $50 
« is ria ' that another adjective seems ne Fe : P el 
chic'. Mr. Taylor quotes this adjective, and adds "ie. imma! $ s 
Equation of the two epithets is his, and not mine. The fact that a thing has i ien 
does not prove it to be “ immaterial”; and I should be the last to hol m aa 
identification was “ necessary ". It might or might not be immaterial: ati ed: 3s 
Hog merely tentative hypotheses; and the best we can do is to Ment i e i m ies di 
Fase each alternative, and carry out further investigations which may 
ees decisively in one direction or the other. « diis something is psychic or 
ccording to Mr. Taylor, however, > z Doux 
ca aterial 5 s are Tocking the laboratory door and [up "i Ma 
an searc i no material existence: à 
‘orm of es something M pes Taylor admits that he sometimes feels pain; so long as 
it lasts, the p eris exist yet it cannot possibly be said to possess a material existence, 
" 
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1 iali ates 
like his desk or his bottle of ink. Even the most thoroughgoing €— he 
existents which are not themselves material. Physicists talk of * fields of force 
magnetic, or the like), and today would, almost w 
scientists of the nineteenth century postulated, that thi 
And my own suggestion was that what I had called th 
in terms of a ‘ field theory’. 
laboratory, and thrown away 
examine the evidence or the 
anything resembling what Professor Broad has call 
reason he gives is that it is not inclu 


: à cm 
ithout exception, deny w ae -— 
ese fields must have a material 


; and they have formed the staple type of defence adopted by MEC 

behaviourist from Watson to the present day. To accept them as valid would be to 
all scientific progress. 

Unlike Watson, however. :ousness 
“ consciousness ' or * awareness °, But he insists that I am wrong to think of consciou 
as a ‘simple and unanalysable relati kes 4 
accounted for in behavi Let us therefore examine his reasoning. He ta 
special case— perceiving the position of 


5 The 
: : an ink bottle lying on the observer's desk. 
physical stimulus, he Says, " not only p 


S tO excite, 


hand to grasp the bottle ", Thi 


» 
ence frame anchored in my body nsional 
requires “ an 8-dimensional subspace of the 11-dime 

i 4 ins (or 
» Which carry out the requisite aud M"; data 
urological findings ”, “The complicated mass 0 
has to be processed Without benefit 


or awareness. Mr, Taylor, however. 
stimulation of these « i 


“a state of simultaneo 
he says, “ postulate tha 


H . H i o E ^ 
5 analysis by suggesting that, owing t into 
€X arcs or engrams ", the organism is Rd o 
multiplicity of learned responses ", And “ finally 


t this state of simult i is idani ith visu? 
t 1 ‘aneous rea tical with 
perception . . | I do not,” he points out, “ say that Cosi diness is iden 
are different aspects of th Clous 


iness 
: ines 
ness and simultaneous read 


Nae 
they are one and the same thing "- sorte? 
e Pw 15 
what confused because Mr. Taylor takes as an ets out to prove? "The initial issue s 


te 
i i complica 
mental Process, instead of the simplest concej p E po hee, to 
I chose the simple experience » as I endea 


: atient 
Walls havea DONO ELT See us apply Mr, Taylor’s ri | = i 
assure him that there was no need for an anaesthetic, « oe he ess d pain," he 
would say, “ is not, as you suppose, an irreducible experiences ae 1. feeling, because 
feelings have no material existence, Pain is nothing but a state of aad, Ms to make certai? 


p 
a 
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behaviour: š d 
iiis pu responses—jumping up from the chair, crying out, and pushing the forceps 
, since as a brave man you will have conditioned yourself not to make such 


Tespo: H 
ponses, there can be no consciousness of pain.” 


Thi T ; 
ftir El of course is a reductio ad absurdum; and it seems clear that there must be a 
mewhere. Nor is it far to seek, What Mr. Taylor originally undertook to do was 
d for in behavioural terms ". At first 


« 

A pos fies = ++) can be fully accounte 

his rie ts Mea he meant *' in terms of actual behaviour," ; it turns out however that 

SUDPoses t iE o be in terms merely of conditioned tendencies to behaviour; and these he 
o exist in the form of material ‘ engrams > in the brain. Certainly, he says, 


Lashley fai 4 
shley failed to find any evidence for such * engrams '; but the failure resulted from 
im to have succeeded where Lashley failed, 


nii nee Mr. Taylor makes no clain 

Sup. me : the engrams : and their ‘activation ' remain à sheer hypothesis. And it is 

proposes A eim state of activation ° in these hypothetical structures that Mr. Taylor 

Thua in the 2 y consciousness. Why? Simply because he “ postulates " their identity. 

Behiasto end, so far from showing ? that consciousness can be wholly reduced to overt 
ur or behavioural tendencies, Mr. Taylor is driven to “ postulate ? the very thing 


he set out to prove. 

Isis ur then is Mr. Taylor's reason for asking us to accept such a paradoxical * postulate '? 

Entro eqs the assumption that consciousness is something ultimate and irreducible would 

ici uce into psychology a concept which finds no place in “ the currency of natural 
entific discourse ". But surely what concep f a particular science is a matter 


to be decid : À ts form part o ila n 
Ho pte led according to the subject matter of that science. A physicist or à geologist has 
A Dew n include in his list of concepts the feeling of pain; but a chemist seeking to discover. 
Gites i gesic does need to include such a concept. He would not be content with “ states 
of ge ultaneous readiness ? as a substitute; yet that does not place him “ outside the pale 
nuine scientific investigators ”. 

due or two of Mr. Taylor’s supporters, however, have tried to suggest oe more 
betw criterion. Mr. Rackham, for instance, has put forward the familiar d 
ove een what is ' public’ and what is ‘private’. Brains, engrams, states of readiness, 
rt actions—in a word, “ material structures and their movements, together with the 
space and time in which they move "—these, we are told, are “ things which in principle 
everyone can observe; they can therefore be verified; and they are in this sense * public ’. 
But a feeling of pain is a thing v ‘hich only one man can observe, to wit, the person who 
feels it; it is therefore * private ', and consequently cannot be verified. We do not deny its 
Occurrence: we merely say that, being unverifiable, it cannot be à subject for scientific study. 
Only by discarding such concepts can we succeed in abolishing subjectivity from psychology, 

and render it wholly objective, like the other sciences ". 
Nevertheless, popular as it is, such an argument will not hold water. 
Pace every observation, whether made by an introspe 
r. Taylor himself, is ‘ private ^. Yet that does not prevent us 3s 
After all, what is it that we need to verify in the case ofan introspection? Not the particular 
which could be 


fact that, duri i i felt a pain 
4 luring dental operations, I or it may be John Jones pain | 
obviated by an injection of procaine, ral fact that practically all normal 


indivi * YT $ roved ossible to 
individuals experience a similar pain a E 


And since it has p. 2 
c ; i <periences, 
establish a large number of generalizations ab riety of conscious exp 5 
We require a scientifically acc nology to descri the phenomena 


eptable termi ibe them. The generalizations 
thus demonstrated—e.g. the ‘ laws ' of colour-mixture 2n Pee ot 
of after-images, reproductive imagery, and the like—are E e iecit D 
the sensory qualities with which we are all familiar. To trans! ate z e Apt im UR 
hypothetical * engrams °’, OF * simultaneous multiple readiness € 

Secondly, the view that “ the currency of natural scientific dun XE 

to mental processes and mental contents 1S plainly based on w AD POR 

teenth century science. This seems to be the notion of * natural scien 
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most non-scientific writers; but it is not the notion of natural science offered to us by scien- 
tists of the present day. Nineteenth century science, though explicitly founded on observa- 
tion, eliminated all mention of the observer. But the quantum physicists and the relativists 
have shown that, except where merely approximate conclusions are required, the observer 
can no longer be ignored. One example must suffice. Measurements of time play an 
essential part in all the physical sciences; and the physicis 
that the time which is measured is always ‘ 
so long as we are concerned (like M 
objects and man-like speeds, all 
was the startling outburst of thi 
by observers in London; in 16 
little longer he would have re 


€ to make a single independent public time”. ‘This is but one 
i ave overtaken the ‘ currency of 
] al science during the past half century, which 
- While the behaviourist has been striving to “ abolish all subjec- 


nd so render it wholly objective, like the other sciences ”, the 
of physics have become 


; (ii) that, w " ;/stematic studies 
ts and processes, we find that a, dad uie iem meet as can be 
ntific Jaws; and finally (iii) that these a 
d in terms of conscious processes: they canno 
n material substances or processes. V"! 
me special type of ‘ substance ’, ‘ ener! ate 
ral Pa Ri ae acity for consciousness, and may therefore conveniently 


arapsychology. Meanwhile, the safest pla? 
els reluctant to sit on the fence, 
Ophers like Professor Broad ar 
case. They tend, on the whole, to 


S the view of the few e lozists who 
is, such as Dr, Tp, Partial psycholog 


to avoid further misunderstandi houless and Dr. Beloff, Howeve” 

ngs, let nd Dr. Beloff. $ 
envisage would not be a dualism of the icu. What I have already said: “ the dualism 
which Mr. Taylor and Mr. Rackham 1an type "—the o 


assertion, this was by no m 
in the paper he criticizes, 


the 
with the particular questions which Me mm problem of Spatial perception, and ET 
invites us to “ consider a number of Doni: A has put to me in his present * Note’? I 
line in both objective and erceiv. E 
p ed 


BET 

Spa ^77» Strung out along a horiz 

Pooh that A is to the right of B, B to the right M 
(he maintains) “as an ordered series s A 


i 
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his ; 

question is twof 

Space’ (i) und xofold: how do I account for th i 

3 er ae e right to left orderi in ‘ i 

describes ^ A er normal condition, and (ii) under certain artificial Sociis EXE 
s th : T9 

denn pope is one first clearl 

interpreted > PP- .); and Lotze’s soluti 7 

i M } ution—that of Lok lzi S igns ' 
neural arcs ’ bead = eee movements and supplemented by m eal esie / 

novelty in his € se i: McDougall—is the solution accepted by Mr. Ta lor. a 

sis lies chiefly in the wording: where ETE of Jj iie 


formati 
ation of get 
associations’ and ‘ i i i 
d ‘acquired physiological dispositions or neurograms °’: 
, 
However, McDougall's 


Mr. Taylo 

notion E. iiec of ‘conditioned reflexes’ and ' engrams a 

guessed from pe and Mr. Taylor call * neural arcs ' was limited to the little that uld 

woul R ek investigations with the ordinary optical dee 

neural POTE TS pees source of Mr. Taylor’s description of his hypothetical 

However, pii: Ee etw ork of neurons spread over widely separated parts of the cortex ") 
quc pue desi an ies with the electron microscope, and the records obtained ith 

answer to Mr. m St greatly added to our knowledge; and I should prefer to sem 

Seems unfamiliar US question primarily on the information so obtained. Since much of it 

of researches publi p "Taylor and his various supporters, and indeed is largely the result 

ished! since his book was written, perhaps I may be allowed very briefly 


to i conn it here. 

e " H 
six types TUE pathway may be regarded 
body (at the PUE Of these (1) three are in the retina, 

(1) The wwe the optic thalamus), and (3) two in the cortex. 

cones; the seco rid neurons are the photo-sensitive elem: i i the rods and 
cells whose bra Y the bipolar cells of the inner nuclear layer, and 
dozen years ago P Oi the optic nerve. During à series of investigations S 
analysis of visual pa S. Kufller of John Hopkins Hospital was ab 
cells of the reti patens begins not in the cerebral cortex, i 
type (no * mo ins In the fovea the bipolar and ganglion cells are m: 
ps ' and no ' diffuse ' or horizontal transverse cell: 


almost 
a set iva B s 
of private lines. Most investigators, however, 
d, not in accordance with the old hypothesis 


limits A A 

of ARET discrimination are determine 

pattern. RA priscis of the images, but rather by the gradients in th 

ganglion cell. Ordinarily u succeeded in i 

ere eno Ext rdinarily the ganglion cells discharge 

with the ilar stimulus; but in one typ i light but sys 

andncreace GE le Bed the stimulating fie 

fn ncresseicE iu pae the rate of firing, and (b) a surrounding concen! 

Stich stimulati ght diminishes the rate of firing; while in the other type of ce 

perceptual 1 on are reversed. Thus here, in the retina itself, are the first st 

localization. 

Fo i on. relay stat 

show. ira d nerve cell in the gen 

Their cane the characteristics of the retinal gan: 

fo:à small Pd pe is apparently to increase still 
(3) The nus point or spot of light and the resp 1 

Bui ped orat res from the geniculate cells pass through the optic 

ate area of the cortex which lines the lips 


y formulated by Lotze (Medizinische 


microscope; and that 


as consisting of six stages and including 
(2) one in the lateral geniculate 


tematic overlapping 
ar area in which 
tric zone where 
]l the effects of 
eps towards 


nerve fibres from the optic tract may 
of the geniculate cells 


iculate body- ‘The responses 
i izable differences. 
n the responses 


ation to the so- 
calcarine fissure 


Hubel, ' Integrative Processes in the Central Visual Pathways of 

LIII, 1963, PP- 58-66 and refs., and for earlier work R. Granit, 

) The Eye, vol. II, Academic Press, 

tina’, J- Neurophysiol., XVI, pP- 37—68 
F 


1 See m i 
a e more especially D. H. 
: TIE 3. Optic. Soc. Amer., 
e Visual Pathway ', ap. H- 
26 
bs 'The Functional Organization o! 


Davson (ed. 
f the Mammalian Re 
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hickened 
i ain they connect with the small cells of the t a 
at mu es P ins tse granular layer, whieh Beas. e e 
Lo Dun indi vith the third and fifth layers, which in d 
CURAE e reus c ut of the cortex altogether. From the w ^ 
SURG ACE Eois pris have attempted to map the projection oO 
e eee cortex, we know that there is a rough topological correspon cm sace 
retina on the Vs n two ; but the correspondence is by no means one-to-one. oe — 
minute areas TH. Hubel and T. N. Wiesel,* working in the Harvard Medical am de 
however, D functional study of the visual pathways as far as the fifth and piden 
eee, important investigations were directed towards discovering how the sonia € 
ae Meise cortex sends out differs from the information it receives. The aa 
pon a subject usually a cat, is anaesthetized, so that all consciousness n pr e 
abolished, and placed before a wide screen about a yard and a half TE an PAR, 
One or more spots or patterns of light, sometimes stationary, a cd jofg gii 
projected on to the screen; and by means of microelectrodes the impulsi 


the 
3 it is found that 
out of particular cells are recorded and compared. Here as elsewhere it is fo 

processes at the synapses may be not 


an 

only excitatory (as the theories of Me y 
"Taylor tacitly assume), but also inhibitory. In the Cortex, however, there e geniculate 
no cells with concentric fields of reception, such as are found in the retina i cells of the 
body. Broadly speaking, it would Seem that according to their functions t = designate a8 
visual cortex can be divided into two principal types. What Hubel and Wiese 
“simple cells ’ respond to linear stimuli—bri 
bright, and straight edges or boundaries 
the line or edge is suit. 


simple cortical cell, to a the 

PIS in the sam It is these * simple’ cells that chiefly make up 

fifth stage in the total pathway. s the sole: 
What the investigators ter plex’ cells form the chief, but by no mean 

elements in the sixth stage. These also 

and contour), 


e 
Spa j ike a simp 
tive in regard to position; moreover, unlike 2 

cell, a complex cell may be activated b 


mulus remains statio im 
Property which deserves special nier onse 
OWS an excitatory or an inhibitory re T. 

o the left of the edge. And here, so Tayi 
» We seem to have an adequate answer to Mr. f a set 
ely that which relates to ‘ the Perceived left-right ordering’ © 


ge, but shi 
e right or t 
is concerned 
first question, nam 
of visual stimuli. 
From a functional stand, 


; into 
al cortex is divided 1” 
tiny columns, roughly cylin 


—in 
E out 0-5 mm, across. In each column: 
estricted space. a 


connections between the Several cells are 
studies, preponderantly Vertical. Mr. Ta 
a restricted locality for a network which is 
advice if we are concerned with the total 


ylor warns the 
Spread over a w "ble to 
behavioural Tesponse; but clearly it is liable 
*Cf. D. A. Sholl, The Organization of the Cerebral Cortex, 1956, and refs. 
2‘ Receptive Fields, Binocular Interaction 


and F Cats’ visual 
Ortex hysio I 196: 10 T unctional Architecture in the Cats 
C x’, J. Physi L.C X, 19. 2, pp. 106 154. ettonal 
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misleading when we are disc n; oble: alizat: vithin ly 
w iscussing the 
g the simpler pr: blem of localization wt urely v1: 
h on w ap y 
sual 


field. 
It will 
relative sid sapiens lei ae I have emphasized—those which underlie the 
ündérlie the identificati ering o stimuli within the visual field, and thi i 
ieee se jon of a stimulus as it moves across the visual field sel thi = nid 
but mm em constant when the eyes move—are the result, not o: ore de 
investigators sh oir he of the neural structures in the saul E Es d 
Ny the branching Bh pomt out, such characteristics are a natural consequence of the 
of this neke emus e of cells that belong to an earlier stage are connected with the cells 
tee ol eases a tag effects of stimulation, they say, can therefore be interpreted “ in 
PC al deuda be t impulse, convergence of nerve-fibres, and their 
tie beb our iof ry action ”: and to understand such effects “ requires no appeal to 
Bisher sachs , complex networks or of electronic computers, Or to theories based 
matics”. If that be so, then Mr. "Taylor's elaborati d 


of “an 8-di ; i ion i 
d i : e explanation in terms 
subspace of an 11-dimensional afferent space, further subdivided 
’ and his insistenc 


into a num " $ 

pereeption ber ak Saimen aen subspaces ”, e on the supplementary 

complex pattern of e irections of the eyes » '' the orientation of the head”, yielding “a 

grasp the bottle Vae conditioned to the motor response of stretching out the hand to 

these further data—‘ jos Becomes quite superfluous. Mr. Taylor contends that, unless 

u registered im e j proprioceptive (i.e. kinaesthetic) rather than visual ”—are also 
e afferent system... the position of the ink bottle cannot be perceived 


as » 
“May I PA that is now seen to be incorrect. 
ink bottle seni d € interpretation of the processes invol 
relatively pale back A vum rectangular shape with vertical sides, contrasting with a 
backeroundironii E und, and that the spectator s eyes are focused on a point in the light 
e left of the square. Then the left hand edge of the inkpot will, I imagine, 


activate tho: $ j 
se cortical cells which are preferentially excited by vertical contours with light 
If the spectator is interested in the location of the 


ink i : ERR 
NS ir e p pen into it), there will no doubt be a reflex tendency to focus 
while the eges oe itsel A ss the field, or if the inkpot moves 
calli] iif chars, b ationary, some of the ce i including all the simple 
duris — i ut a specific group of complex cells will not change, unless the vertical 
Fasadiness? to le or move beyond the cells’ receptive fie! Thus movement, Or 
RE THESE nake appropriate movements, are by no means necessary for localization 
visual field. Provided it was equipped with a nervous system similar to that of 


the hi $ i 
gher mammals, Condillac’s. sentient statue—which possessed only à single sense, 
res, head, arms, hands, or legs—or (if such a fancy 


21: vision, but no power of moving ey 
am em far cases a child completely paralysed from birth—would still be able to identify 
Sin ize the inkpot in a purely visual field. 
en T e Le 'Taylor is convinced that consciousne: 
EEA y E. make appropriate behavioural responses, 
Very rss d ut it now seems clear that, once again, he has really assume 
No r int he is professing to demonstrate. By insisting from the very outs beh : 
the nterpretations he has been led to confuse the problem of mere visual localisation with 
i FA complicated problem of visuo-motor coordination. In his analysis he therefore 
cludes such “ motor responses » as successfully « stretching out the hand to grasp the 
bottle ", Now an infant less than one month old can successfully follow a moving light wi 
es eyes; but not until it is 4 or 5 months old will it succ hat is dangled 
within reach of its hand. Here its eventual success n d partly on matura- 
partly on practice and 


ti 5 x à 
ion of the neural mechanisms for eye-and-hand coordination, 
But in such a case, as Piaget has pointed 


ved? I shall assume that his 


ss is impossible in the absence of 


he would of course reject such an 
d in advance the 


et on behaviour- 


and 


conditioning of the kind Mr. Taylor describes. 
out in his studies of children's perception of space, the ' space » with which we are dealing 
f the visual field, but a highly organized visuo- 


is no longer a purely sensory extension © 
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kinaesthetic-motor space; and this is largely a conceptual space, and by no means sees 
perceptual. Hence the discussion of its detailed nature and development is really irrele 
to the simpler question in which we are here concerned. : A 
Mr. Taylor, however, challenges me to explain one other paradoxical result whic EU 
thinks is crucial for his contention. When, with the aid of special optical apparatus, K 
“structure ’ of the subject's visual field has been reversed, an adult subject can, after 4 
period of re-conditioning, make the right motor responses, but “ printed matter eid 
to be seen in reverse " i.e. he is unable to read the mirrored print. Mr. Taylor describe 


this by saying that “ one portion of the field has reverted to its original structure, while the 
rest retains the new structure ”; and he asks me “ what sort of a field is capable of changing 
its spots in this odd fashion? ” 


The problem is a far more complicated one than Mr. Taylor's account implies. I have 
discussed the factors involved in several 


young or old, do not re 


port any startling i 
fields, such as Mr. Taylor's description wo 


insists on “ considering the problem as 


object in the “ field ”, whether inkbottle 
ordered points "; and each 


expressing in “ numerical 


d inates, 
€ its own “ parameters " or coordina 
of reference ”, 


Ir e 
* analogues " its position in an abstract ue 
way we build up our visual percepts or recognize obJe 


ld may fail where previously he succeeded. bes 

» , o centy, a printed word is not “ a system of or’ ^s a 

(as it is of course for the television screen): PRF: 
n—an idea, an object, or it may be just an artic 

|.—or 

not (as Mr, "Taylor assumes) the constituent point, but the total word o 


E é es 
€ is only one relevant direction for the ey 


ignifvi ©’ printed backwards, but is seen aS 

e s É 
Pe signifying the sound ‘ ob’, Generally a. therefore, to 

arn a different set of patterns, just: my 
S mode of perceiyi ds, so far à 
f Practically all ed, Perceiving words, taken 

lucati ; e 

Kohler (referred to by cated adults, like those who hav! 


own laboratory. aylor) or in similar experiments 1? 


But in certain cases the unit is dif : he 
old alphabetic method find it much | 5 x un ae Sip have: bears tant ed 
handwriting quite illegible; mirrored numbers, as in ee iis 1 eet em M, 
little difficulty in deciphering Greek inscriptions sien d icis a I odi re 
Egyptian hieroglyphics almost as easily when they have to E vi inscia left or fro 
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above downw: ; 
fen Isti were kc they are printed (as they usually are in modern transcriptions) 
A prd xt this is because the hieroglyphics consist of phonograms or pictograms 
Enn De e meaning whether or not they are reversed: the schematic hand which 
Cassequantly pem just as easy to recognize which ever way the fingers point. 
setite Be P ES s generalization is much too sweeping; and on my theory the 
Sedit uld present no paradox. They are indeed precisely what I should 
Moreo i i 
ver, his contention that sensory localization is only possible as a result of practice 


in motor localizati 
alization breaks down completely when we turn from vision to other senses. 
pain in my appendix, although they are in 


Ic 

aha ie a ani on the small of my back or a 

ih piri Fa bx not possibly reach; and every student of psychology is familiar 

uec e deem i ich a blindfolded subject 1s asked to indicate with his finger the place 

donbüco Seen u Lus then more often or not points to a position quite different from 

V MERE ers . The sole effect of practice on sensory localization, when it has any, is 
re precise and integrate one form of localization with others, not to make it 


possible. 
In so ; 5 
Écs? the ue ark experiments I carried out with Sir Charles Sherrington at his suggestion, 
cular surfaces of my eyeballs, and then their kinaesthetic sensitivity, were 


an 3 HO quee. 

|i one AE rea of cocaine; in these conditions I attempted to localize with a 

o: ther ofthe dm. t wl ich appeared in front of me in à dark room. Anaesthetizing one 

Niere anaestheti es appreciably impaired the accuracy of motor responses: when both cues 
sthetized, my attempts became astonishingly erratic. But the visual localization 


of t] "—— k 
he spot within the visual field was in no way altered. 
ciative local signs similar 


However, even those who originally advanced a theory of asso 
ppose that a knowledge of the underlying 


oot E Mr. Taylor now supports did not su 
deem; UE piment would supply a complete interpretation of spatial consciousness. _Lotze 
says ee aie and in this he was followed by McDougall. “The activity”, 
of the positi gall, call it creative or not as you please—which constitutes the final knowing 
itself." ion of a point, a star in the sky, for example—can only be attributed to the mind 
link "n before we can determine the detailed nature of these fin c 
Anah e actual knowing > to the related neural processes—far more research is wanted. 
ere, up to a point, I should agree with Mr. Taylor’s mode of approach. It is a sound 
in terms of neurological 


isla el principle to explain as much as we possibly can r 
activities before we go on to formulate supplementary hypotheses about the working of 
ve already quoted, emphasizes, the immediate 


the mind. And, as Dr. Hubel, in the paper Tha’ a 
need is to pass beyond the Sixth stage to next stages within the brain, and observe how far 
at will help to elucidate the way we perceive and localize objects in visual space. Never- 


theless, a complete interpretation solely or predominantly in terms O' 
he admits, by no means easy to envisage. 


impulses, and neural connections is, 

one serious difficulty in such a scheme is that it would presuppose an enormous degree of 

cortical organization ". Let us, however, suppose that such a scheme has in the end been 

satisfactorily worked out; there must always remain the last stage of all—the stage in whi 
-fbres to the 


we pass from discrete currents in separate nerve- 

continuous visual field as we perceive it, with all its meaningful contents—a sensory fiel 
which itself is merged with the general ' stream of consciousness j up the life- 
history of the experiencing subject. To compare the two in any detail, we shall have to wait 
until a second Wilder Penfield has made recordings with microelectrodes, placed not on the 
cortex of an anaesthetized cat, but op the cortex of ious human being. Yet, even 
when this has been achieved, it seems pretty j dence between the 
cortical processes and the conscious experiences will not be—indeed cannot be—exact, and 
that consequently part of the final organization will f what I have called a mind 
or neuropsychic field. The assumpti! mental processes thus 


on of a mind and of distinctive 
seems in the end inescapable. 


al stages—those which 
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SECONDARY SCHOOL SELECTION 


To the Editor, The British Journal of Statistical Psychology 


hool 
j ; me belated comments on the book “Secondary Scl s 
Sel re i Nux rte of the British See ee eT pep 
wale blished in 1957. think it we a 
pare ena ed 5 = m be removed even at this late date, for = 
pou ome Kip A i euet and conclusions without question, as it x eR 
rud af nee distinction in the field of psychology. I must add that the delay 
Medos these comments comes from circumstances beyond my control. -€— 
I have always thought that the individual intelligence test, such as a E m 
Merrill, has acquired an undeserved esteem amongst psychologists as pasion 2 BRE 
gence, whatever its merits for clinical purposes. One reads in the book t al eter E 
Merrill test gives ‘‘ an accurate assessment of an individual child » has f cima eu 
worthiness " (p. 94), and provides “a more reliable and representative al " dnb 
of a child's intellectual powers ” (p. 95). Strangely enough, however, the autho: 


Td ms RS rk than 
“there is no evidence that it is more predictive of ability to do grammar school wo 
is the result of a group test” (p. 95), 


Is there indeed any reliable evidence at Mo 
predictive value? The test is used in difficult borderline cases for want of better, voa att 
its standardization relative to a particular education authority, both as regards me sal 
standard deviation, must be in doubt, and also since its correlation with a group eo d 
intelligence test having a validity of 0-8 is only about 0-831, not much reliance can be p =S 
on its results. Incidentally the distressing wastage of information acquired in the cour 
the test offends one’s parsimonious instincts. 

The authors are not hap; 
They desire one containin, 
attainments (p. 73), for * 
in school examinations rı 


py in their discussion of a criterion of grammar school nd 
g estimates of personal development as well as intel e =E 
“a child may profit more from a secondary school than his awe is 
eveals " (p. 68). They overlook the fact that the criterion uen oól 
one that represents the difference between the effects of grammar and modern sc ee 
education, and if the two types of school develop character equally well, as is likely, an 
inclusion of personality traits in the criterion is vain. They require a multiple criterion 
“not merely an averaged 

elements of a composite c; 
Suggestion that more is w 
latter is a‘ measure ’ of th 


ible. 
(p. 68) is not immediately comprehensib 
Here and there an unfortunate lack of precisi 
Such as “ there is likely 


overall proportions of able children in Kent 
and in, say, Cornwall” (p. 17, footnote) is 
evidence; the proportion 
cent to 25 per cent accor 
interpreted, 


ppendix A might have been better chosen and most should € 
McClelland’s table? on Page 178 calls for special comment, 


been more fully annotated, 


1 The Trend of Scottish Intelligence, Univ. of London Press, 1949, p, 123, 

*See also A. E. G. Pilliner, * The Position and Size of the Border-line Group in 4? 
Examination "', Brit. J. educ. Psychol., 1950, 20, 133. 

? W. McClelland, Selection 


XXII, p. 71 fe Secondary Education. Univ. of London Press, 199» 
Table X- s p.71, 


z 
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as it is and always has b T F 
of the three as be misleading. The correlations wer d 
peream ncs oe a p pe (a) the predicting meld Ms cris bol 
E e es ee 5 rae years respectively. In my view performance at th 
only to the seco P arauis the only relevant criterion. Correction for sel t ms 
the data niei em and third year results to bring them into line with et cher applied 
to the whole po iets not comparable with other correlations corrected Em 3 SET 
the whole tal pulation. Finally, the intelligence test is the only non- uis applet x 
preted to ecd e its appearance at the bottom of the order of et ats iie gee x: 
(ibid. p. 67) is agate by the unobservant. The last column of McClelland’s Table XXIV 
third-year perfo only table relevant to the purposes of our book. Here the MEO i 
"'hesiotelligence mem correlations of which with the several single variables are pue 
occupied only 45 oo now shown as the most predictive of all the single variables, although it 
minutes for the pi umen against 125 minutes for the traditional English paper and 7! 
criterion, arithmetic. McClelland gives no battery correlations for the third year 
he two tz 
comparable, a ot pagoi extracted from Jmut’s article? are not 
ea AE Age ms table relates to correlations uncorrected for selection and the second 
by the n p e latter point not being mentioned. The substitution of the first table 
ouli anete ee would have been more instructive. The table on page 181 
3 years in re ples the criterion is based on secondary school teachers’ estimates after 
Richardin ss school and that are corrected for selection. 
Oa:pags 134 we d les on page 182 sh orded as corrected for selection. 
papers with "idis ee of her comparison of ‘ home-made English and arithmetic 
validitvof tha Su ; ouse tests. , Reference to the article in :on? shows that the 
(Hoe one and b er 1S judged against a criterion assessed after one year in grammar school 
o years " as stated in the book while the Moray House tests Were correlated 


Emmett and Wil 


with criteria 
a after five a ; x 
of fuller T EDS nd three years respectively—2n unfortunate compar! 
ppendix B i A i 
is a poor effort, obviously written by a lay statistician. Most of us 
should recognize that We are but amateurs at the 
ialist 


rutiny of à spec 
passed muster. 
« 


ed oni É 
statisneiad baloi and should submit owr writings to 
1s esricerned ue TR Cu this appendix would certainly not have 
Variability of IQ M he Constancy of the TO "Or iger 
different mental oe easurements » Now different intelligence 
test is in mind d saute. so that to be precise one should specify 
they regard the pee be oe ae! of IQ is talked about: This view th: 
results (p. 180, Í ie de tests on the various occasions of testing 4 
THE (ise ¢ jus cannot agree. 
of probable errors with a constantly appearing factor of 0:6 
n variation as bewildering. One finds 
eange fa 


and the definition of a probable error as the “ media 
“ maximum range of variation » when simply 
' which may mean anything. Alge 
tion, and a quantity js said to be “ raise 
or and no itive. 

imation of variability 


ary conditions 


The correlations quoted, many 
Jiability of modern 


745 is archaic, 


another quantity when the se 
i itr choice o: 
pe ave been made. c 
iyin sia estimates and might have been : ib & 
g between 0-7 and 0:8, certainly give à wrong impression of the re 
rtificate Performance in 


The Prediction of School Ce: 


1 

CMS Sus and F. S. Wilmut, tu 

c Subjects, Brit. J. educ. Psychol., 4952, 22, 52. 
Sch Kur Richardson, “ Some Evidence relating to the 
ools ”, Brit. J. educ. Psychol., 1956, 26, 13. 


Validity of Selection for Grammar 
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es ive Dun i ited to 
i bal intelligence tests sull 
ts bili trast, pairs of Moray House ver t eee 
E qi s f ebili f z t+ UNE and administered to several mae ey —— E 
de E UE aniling to correlations of 0-94 after 2 months, 0:92 afi 
differences A 
i rth whi 
_ The. s een s: as a whole is so perplexing that further Fiir R Aor mB 
etica i ily involved and in places 
isti tant found it unnecessarily 
My statistical consu. 


W. G. EMMETT 


A REPLY TO MR. EMMETT’S LETTER 


" is by now 
Sir, —Mr. Emmett's comments certainly deserve attention, even if the pes s 2 ad ul 
ce outdated. I am grateful for his clarification of McClelland s ai Letter tanto 
ten h I see no reason to agree that a 3-year follow-up criterion is dy in his 
n 1st to 3rd year criterion. Also it is noteworthy that e D. ep to the best 
general survey of McClelland’s results in 1948, bases his final Here mett criticizes: 
battery for predicting secondary school success on the same table that r. intelligence 
I would disagree that there is any inconsistency in admitting that = Terman- 
tests give as good predictions of secondary school examination marks as 


te Ns easure O 
Merrill scale, or better, while yet holding that the Terman-Merrill is a better m 
intelligence, particularly in assessin 


$ ions to the 

g emotionally disturbed pupils whose aa of the 
group-testing situation are in doubt. There can be no satisfactory external e of construct 
validity of the Stanford-Binet type of scale; it can best be judged in terms 


: : - redictive 
validity. Perhaps the most convincing contributory evidence is the long-term p 
value shown in Terman and Oden's follow 


I.Q- 
Mr. Emmett's major objections are to Appendix B on ‘ The Constancy of the 

and I daresay that it might have been wi: 
statistician in writing it, However the whol ne d severa 
the Council of the Society, which included at least two accepted statisticians, an 
modifications were made in 


ad at à 
; and even if the Terman-Merrill is employed, he will be tested à 
different point on the scale on the second Occasion. or at 
The main issue then is that some psychologists and many educationists talk, thers 
least used to talk, of the LQ. as being constant for most practical purposes, while MS 
point to such work as Honzik's or D. hney's to prove that it is very far 
constant. And the correlations be 
time apart provide no basis for ass ; à 
Appendix is not “ unfortunate ” ; it is the most relevant to the everyday interpretation o a 
child's'I.Q., and much of it is constantly cited by those who wish to argue that the LQ.15 
is not highly variable. The survey aim 


earborn and Rot 
tween the same 


educational discussions of the constan. 
of statistical terminology. As for su 
he would like to suggest a better te. 


cy problem th 
ch phrases as * 
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IS INTELLIGENCE NORMALLY DISTRIBUTED? 


To th ji iti 
he Editor, British Journal of Statistical Psychology 


Sir,—M i 
ay I raise a query about Table II of Sir Cyril Burt's paper in the last issue 
ion of children with I.Q.s 


of this Journ X 
Tires M ecce] 
Tn estimate maii is oed erri kae a no indication of the accuracy of this estimate. 
btained in Tabte Te conse ! y of the parameters for the Pearson Type IV curve 
directly, or indirectly by me Mui d epica Era oic 
Fo ihe direct orea ring the variation in the estimates of the Type IV parameters. 
dhilldren actually: cà 2 ch we may note that Table I shows that the sample of 4,665 
milen anda ly onia i child with an I.Q. above 160. One in 4,665 is 216 per 
Onrtbiexora hand pda m gives 5 and 1,194 as the one in forty confidence limits. 
CERES other x Pia imits include the Table II estimate of 445, which is gratifying; 
ther? , they are extremely wide. Does the other approach enable us to narrow 
The 
Slice; deu nparo e seems to me to be beset with formidable difficulties. In the first 
Secondly, for Type tee! does not give efficient estimates, except in the normal case. 
voee ae ie t s higher moments are infinite. I think one might perhaps circum- 
ER CHENEY ve get some sort of assessment of the variation in the estimates of the 
iore pune ES ia e not persevered far with this, because, aS it seems to me, a third and 
iones e thie Se z looms behind. 1 Why should the search be limited to the Pearson 
ranpRAehnrorne te ype IV gives satisfactory agreement with the observations within the 
ihe AE ipe exist; but outside this range some doubt is thrown upon it by 
kense:te]lsruá Mes es a non-zero chance for any 1.Q. we ion, while common 
MM E: there must be some limit, ere that limit is. 
RUER Poma hese chances are exceedingly small, s be neglected; 
eale perd clear that this is the case when we are concerned with extreme values. 
inverno t reper 2 to try a Gumbel curve for the extreme value problem; but I 
Bart suos Ho dà ^ a at present. More data, however, are really needed, as Professor 
Sonar eae ina paragraph. In collectin: would surely be a good thing to 
ios cdm ei iod on the extreme values. . f low and moderate values 
many xem ativ : y little relevance in estimating f high values, because 
Cun Nan lt E: the tail are compatible with muc in the middle of the 
pa n. It would not be hard to f high values without à 
EE leks of the whole range, because m 
ie an É ome, no doubt, would be missed. None the less I shou! 
usb: e a much more helpful approach to a reasonab. 
ame amount of labour in covering the whol 
for the whole of England would in any case have 
otherwise there would not be enough degrees of freedom between primary samp 


In my work for the Ministry of Education 
hese have been the first stage of à 
dd that there is an example 


Any estimate 


at least a dozen places; 
ling units. 


Education Authorities when t 
schools as the second and pupils as the third stage- And I may a 
of a different kind of ‘ extreme value ' problem at p- 280 in the Newsom Report. 
G. F. PEAKER 
Reply 
oth the surveys and the 


er has said, and hope that b 

atically tried out. So far as circumstances 
ts to determine the number of children with high 
ded these to give a rough indication of the 
The relative frequencies showed a wide variation 


I agree with nearly all that Mr. Peak 
calculations that he mentions may be s; 
permitted, I myse 


values for the 1.Q. (loc. cit., P- i 
accuracy of the estimate which he queries: 
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an as 
i from Scotland 
i ible to include rural areas ex 
$ ther. Had it been possible le ral M 
pe Yom Wa un of variation would have been wider still, and h 
i E | 
well as Eng « Geist limits ’ that Mr. Peaker has computed. "v population 
close to die chief reason for starting with samples of the z iagliby E 
pee deu 2 more general hypothesis. It seemed to me ig 
was the desi 


irel; 
ry causes were not ee 
y a ii 
braically that the resulting eps ihe 
Pearson's Type IV curve, es *icinifüce 
o indicate the relative importance of Ld Pese 
i i 'son ty * 

ial’ components. There was a further advantage in keeping to the s Type IV yields 
tori h es most frequently used for other biometric data, ‘I he fact thai i ener ad 
ael e like to mention ” is to my mind a merit ra akato 
le to specify any finite limits: whatever ow X sic 

a with yet a higher I.Q. mig! gin that 
» I fancy, is sufficiently satisfied when Mee eerste 
finite’ amount of intelligence would only occur i 
to sample a population of * infinite ’ size, 


Cvni. BURT 


OBITUARY 
PROFESSOR NORBERT WIENER 


iener, mathem. 


jz e was educate 
literature at Harvard University. He w fee AB. 
Tufts College, Boston, where he receive 


ally 
- Army, Aberdeen Proving Ground, and fin 
Boston Herald from 1918 to 1919, in 1919 
association with the Massachusetts Institute of Technology Mathe- 
t, Associate and Full Professor in 
ne of M.IT/s select Institute Professors, 
Wiener travelled widely, 1 onwards he w 


a 
: s; : atistic 
i University of Paris; Indian St 


B 


tterly» 
ysics and Cybernetics, Naples; and la 


A few months ago he was one of fiy, 
Medal of Science, Wiener was delighted 
his friends, It is gratifying that he lived 

Among his publications (over 200 in 


A teg!” 
8 number) were many books: The Fourier Inte. 
and certain of its Applications (1933); Fo; 


€ men to wh 
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R. E. A. C. Paley 
Sore a 49); pa ora an ee in oe Smoothing of Stationary Time 
as 1 am a NER DUE due 5 tes [uman Use o Human Beings (1950); Ex-prodigy 
kd q 2 59), = d God and £ xe (s verd Problems in Random Theory (1948); The 
SEbhet siii incipally a mathematical analyst, althou is earli 
drawn Nes Menos gd logic. In all his later "ut he sg du ri ih 
ashy pRpeHrán the er of physical phenomena. In 1921 he published the fate: 
Gharles River oars mathematics of Brownian motion, after musing by the side of Bost 5 
of papers on the tl is nature of the irregularities in its wavemotion. ‘This initiated a E 
Bily aeiia abe of integradon in function-spaces, in which certain Gaussian oe 
in. sired en called Wiener measures, were introduced to describe the Brownian 
n ee k was closely linked with Wiener’s studies of the Fourier Integral which 
x itlieoryof general jenem of Tauberian theorems, a proof of the Prime Number Theorem 
same time, he a oa quini Analysis, and in his later work on Ergodic Theory. At the 
ed new developments in Potential Theory, which have since been 


incorporated i 
a into tk i i 
he modern Theory of Potential. More recent work by Doob, Fekman 
0 > 
Wiener measure and the 


and oth iit 
Wienese sehen, Se atti Wiener’s physical intuitions, and the 
Theory gral have been used extensively in Newtonian Potential T'heory and in Quantum 
His interest in all thi ; 
was nai hings oscillatory led him to communication engineeri i 
of toda he should play a large part in the revolution which Rp rele ME 
techniques, poem us art into a discipline possessing a good measure of exact and powerful 
fox anticaizorats =: s work on wave-filters, on prediction, filtering and control apparatus 
equation proved a “epee an integral equation, now known as the Wiener-Hopf 
badle contrel medi e 0 fundamental importance), and on the general problems of feed- 
hereitbar We oe dates from this period—the late 1930's and early 1940's. It is 
based solidly i i work on Harmonic analysis, initiated by physical considerations, and 
design. of whos] he work of Fourier, Gibbs and Heaviside, came full-circle back to the 
physical hardware. This linear theory is now à basic item in the electrical 
/nian motion and stochastic 


engincer's a 
emerit si i More recently, he used his theory of Brow 
evelop a non-linear theory, but there has been but little practical application 


of this to date. 
iim ni pm a very wide circle of friends and colleagues, among them many 
Talia Bigelów Wh with animal behaviour and neurology. In 1943, he collaborated with 
Short paper o Mun be aes and Arturo Rosenbleuth, a neurophysiologist, 1n writing a 
Cybernetics, i.e. the ds scie in purposive behaviour, and so began the science of 
machines. Together wu study of control and communication in animals and 
bahsviouris bx igelow, he recognized that what is important 1n controlled 
not so much the feedback of energy, but the feedback of specific signal patterns, 
d computation 


He had also been studying the requirements for high spee 
and was led to a consideration of the analogies existent between the 
rks which were beginning to be used 


deas on these subjects in the now 


or messages. 
by digital methods, 
neural networks of the brain and those switching netwo: 

E high speed computation. Wiener presented his i 
pans book Cybernetics, published in 1948. A highly personal book, it has proved an 
nmense stimulus for much brilliant interdisciplinary work—and alas, in the hands of 
men of less comprehensive intellect than Wiener’s, has also stimulated work with no 
in his theory of 


discipline at all. Herein was defined (independently of C. E. Shannon, 
f noise) a measure of information closely related to J. 


communication in the presence o 

Willard Gibb’s measure of entropy, around which a theory of signal processing and trans- 
mission has since been constructed. With this work by Wiener and Shannon, scientists 
and engineers gained a sensitive and reasonably plausible (but by no means all-embracing) 
measure of what is relevant or irrelevant (“ signal » or “noise ”) in situations wherein 
organisms, or machines, interact with their environment. 
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Since then, of course, Cybernetics and Information Theory and the companion 
subjects or Automata Theory and Systems Theoty have developed and diversified in 
multifarious ways. If their lasting impact on the fields of Neurophysiology, Psychology, 
General Physiology, and the like, has not been as spectacular as was initially expected by 
the cyberneticians, it is fair to say that very many “ orthodox ” scientists have been stimula- 
ted by, and have used the notions, if not the theorems, of these communication sciences to 
great effect. 

Wiener was quite concerned about the socio-economic aspects of the automation of 
industry, which he predicted would follow the development of these sciences, and made 
many efforts, seemingly not too well received, to alert a wider public to the need for long 
term planning of the next Industrial Revolution. Perhaps he lacked perspective on the 
reaction of individuals to automation, but his warnings are nonetheless important—even 
more so now. 

> There are many stories in the Wiener mythos, and we recount here only the one we 
think the best—and make no claims for its veracity. One day an M.I.T. professor saw à large 
number of the most brilliant mathematicians from M.I.T. and nearby Harvard milling 
around Wipers office. He asked one of them what it was all about. ‘ Wiener hee 
rie mann Hopes, and everybodys came to see his prot”, Exit 

started to talk, chalkin, jeucs to witness this turning point in mathematics. per 
t g up an imposing array of integrals and Fourier transforms and infinite 


qd stray listeners with a flow of fascinating vut ane 
3 pleasure the image of thi int figure: 
ossessed ge of this short, rather qua : 

5 sed of bifocals and a large cigar, walking splay-footed around the Institute, or regalin8 
ecess with vaudeville songs of Boston's 1920’s. He pucr 


Ex-Prodigy, E 
For ven at the 


Theory and the Brown : ; learning Dutch, pouring forth ideas on Quant 
! ian motio: and Brain modelling, full of eod 
i hes a great shock to hear of his wA 
hat he i Á efore was still fresh in our minds. 
he is dead, and that he will never again Propound a new idea to a student, 
at he sings no more. ing " and wait to be told that itis. 1t!* 


J. D. Cowan 
M. A. ARBIP 
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BOOK REVIEWS 


Psych " 
ychology through Experiment. Edited by GEORGE HUMPHREY. London: Methuen. 


1963. Pp. 307. 30s. 
T i ee 
Wise ich this is a useful book although I doubt whether it accomplishes quite what 
ntended. It is said to have two aims. One is to provide " a companion volume 


for a practi 
practical class doing experiments . . - The second . . . is to induce those primarily 


inter i 2. 
ested in the humanities to take a glimpse at the kind of thing going on in practical 
have been concerned to fulfil the first 


classes". T) i 
S". he contributors themselves seem to 
d without being 


of these ai 
define asd RR rather than the second. Thus technical terms are use 
the presentation is often much too condensed for the reader with no background 
introductory section 


in 
arp eoa PE barrier to the general reader is that there is no in 
Regarde S esign or on the role of statistical techniques. , 
Tt svealiiéss em a companion toa practical course the book is certainly more successful. 
for the beginne e jp heterogeneity. Hunter's chapter on learning 19 clearly intended 
féader in mi r. (He is perhaps the only contributor who has tried to keep the general 
mind). Yet Deutsch's chapter on experiments with animals is suitable only for 


th ati 
e relatively advanced student. Another aspect of the book's heterogeneity is that the 
l techniques where the assump- 


ceu Fac dic smi in their willingness to use statistica n 
SPEI] witen: mg uq The introductions to the experiments are often extremely 
psycholo, 1 A the book has considerable merit simply as à collection. of essays on 
of desine d ndeed, Gregory s excellent chapter on sensory processes describes a number 
(N.F ca emonstrations but no formal experiments. Other chapters are on perception 
Som é o oh motor performance (H. Kay and J. Szafran) and thinking (B. M. Foss). 
of Ee ividual points call for comment. Page 73 contains à very inadequate definition 
ihe use of] UN information is defined as the logarithm of the number of alternatives, 
for guessi logarithms being convenient’. On page 149 an incorrect method of correcting 
the/ex sing 1s given: if the ratio of old items to new items in a recognition list is 1 to 2 
cti d ratio of lucky to unlucky guesses is 1 to 2 only if no old items are eliminated 
cal  R'üeSeIngs On pp. 151-2 it is stated that two sets of scores can be compared by 
alculating " the probability that the obtained difference could have arisen merely by 
chance ”: the student cannot be assumed to understand that “ the obtained difference | 
is short for “a difference as large as the difference obtained”. The statement at the top 
of page 154 is dubious in view of the evidence that either recall or recognition can affect 
subsequent recall or recognition. Finally, on page 253 there is the arresting statement a It 
1s possible that the motor theory of thinking holds only for certain extreme types of people ^ 
This suggests that some people think with their muscles and that others think with their 
nervous systems. However, perusal of the context shows that what is meant is simply that 
movements may accompany thought in some people only. Jonn BROWN 


Some Aspects of the Relative Efficiencies of Indian Languages. By B. S. 
RAMAKRISHNA, K. K. Nam, V. N. CHIPLUNKAR, B. S. Arar, V. RAMACHANDRIAN, 
R. SUBRAMANIAN. Bangalore: Department of Electrical Communication Engineering, 
Indian Institute of Science. Y ; 
Indian, with its numerous independent languages spoken by Jaras po compara: 
whom English i rovides a natural ‘a o: a 
cas aie secondary d These opportunities have been exploited 
ethods based on 


s investigations of the translation process. ak leia 
admirably in this little monograph, in which the au ors have de : i 
the information measure for evaluating quantitatively the relative efficiency oF ae 
between English, as a common reference Janguage, and six of the most imponi ren 
amil, Malayalam, "Telugu, and Kannada). heir study 


languages (Hindi, Marathi, T: 


94. Book Reviews 


c af ; asure as a 
; ion for its clear and intelligent development of the ba ae deep Eo 
ue ode ing translation, quite apart from its more topical imp icati 
Fr aired dw De and disadvantages of the specific oe ee M —Á 
i i i £ “ semantically ale E 
Their approach is to calculate the San pies oN xo ep cde ae aa one 
English and in ree: tek Bref E «ei expression, they give os 
See te nia s in English and from English into each Indian language. kerda 
FE oe ES — entropies obtained in Opposite directions of translation, E ues of 
see E the. facility with which semantic content can pass between any Ie lari? 
haces antity that may well prove of considerable value in evaluating the at English 
languages, E fomir of different natural languages. Their results indicate ba E 
Eie ici content more efficiently than any of the Indian languages, » s then 
= ihe most efficient and Hindi the least. From the point of view pa f a M enis E 
differences can be considerable: nearly 25 per cent more time is req 
given message in Hindi than in English, 


was ian 
P s " " riting India 
A second issue the authors have attacked is the relative efficiency of writing 

i ional seri 


j nalish, his 
Scripts or in the Roman script adapted from Englis 


: ir method o 
ns than the work on translation. But their r 
attack is always sensible 


Aa ae 
E 3 : R ; ractice 
and often Ingenious, as in their way of evaluating pra 

rent languages, 


3 T «position O 
€ forth claims for their conclusions. The SS rly 
the logic behind their methods is exceptionally clear and concise, traits that Ee HNE 
welcome in a field where they are so rare. inai 


w. R 
Bibliography of Basic Texts and Monographs on Statistical owe EM 
BUCKLAND and R. Fox, Edinburgh and London: Oliver & Boyd,1963. Pp.vii 

5s. 


In 1949 the International Statistical Institute 


titled 
introduced a programme en 
tical Education, 


. ored an. 
One part of the programme, which was spons teaching 
reparation of various aids to riginally 
The first of these bibliographies, o 


iten 
» all in English. Most were med 
$ of greater importance are also n reviews 
dings of a book and then quotes extracts taken from titles 
ied journals, There is also à supplementary list giving 
of works appearing in 1964 and ; logical 
i Piling this work. As far as pons y 
T Suitable nor representative. Cer 
oes well, since th British Jou 


ORY are all quoted, but this Foun e " 

erican PSychologica] journals were ur gists 

an especially remarkable omission bei As a consequence psycho nodo- 

; ncerned with their particular met pu 

eceive no mention. Therefore this ping: 

ch wo? the Psychologist involved in undergraduate A 

On the other hand, the research Wo; o is used to independently exploring the mpi 
iblic TOvides an easy means of locating suitable x 

sitions of a wide variety of topics in Statistics ang Probability theory, R. J. AupH 


S 


— 
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Statistical Esti " 
Stimation in Fact : 
Bee G. Jork ctor Analysis: A new technique and its foundati 
Toresxoc. 1963. Uppsae, Almquist and Wibell Pp. 145. — A 


The subtit i : 
a new factor Mex d. tie teme i isan essential part of the title, as the author puts forward 
hypothesis tenting ae el, and discusses in detail the problems of statistical estimation and 
requires PRE E ph suse 'The book is thus essentially a research monograph, and 
statisticians and Hie peu e before it could be recommended to a wider audience than 
Broadly spealtin She rt actively concerned with the methodology of factor analysis. 
but a new ria he model assumed is still the orthodox linear multiple factor model, 
ing the effects of the assumption is introduced, viz. that the residual variances, after remov- 
elements of the inve E uP factors, are proportional to the reciprocal values of the diagonal 
to lead to sligpilifeafion population dispersion matrix. This assumption, while it is claimed 
niques of the kind EU iEn the inference problem (such as the avoidance of iterative tech- 
arbitrary, and to be i edi in Lawley's maximum likelihood method), appears to be quite 
convenience. To a vocated not so much for any intrinsic plausibility as for technical 
(standardized) im teg a ha, of co general factor and three tests, so that the 
given, say, by 
xy=mftsy1—m? 
xo m9 msf ss — ms? 
x5 mnsf t ss 1— ms? 


V h e the i 
e hav reciproc: i ix a 
iprocals of the diagonal elements of the inverted matrix as 
(1) 


Where A/( —ms20,2), | A[i—0,9m,), A/C — m,m’) 
A=1 — (m,?m:? +m ns? +m1°m") + 2m,*3nyms?, 


compared wi : 
with the true residual variances in this case 
However, tl 1—m,%, i-mj, i—m;* (2) 
r, th i + ? : 
, the technique appears to give a very good account of itself when tried on 
The data tested out are of two kinds, 


actual da P 
artificial Mme Mr hardly be dismissed offhand. 
enables the analysis i rel of artificial data is not of course to be deprecated, as it 
extensive series of ex = tried out under conditions which are precisely known. An 
factors. It is debe arp was made, ranging from 10 to 30 tests and 2 to 6 group 
to satisfy the extra tre to notice that these artificial series were not necessarily restricted 
remarked in Chapter IIT E a restriction which would have been open to criticism. Itis 
it is claimed (p. 71) that d at this implies a specification error in the residual variances, but 
order or magnitude s 6 unu a specification error in the factor loadings of a smaller 
case of aipproximatdl S A Iu case zis discussed in this chapter, but this isa 
largely resolved b af que atent roots leading to factor identification problems, which are 
clusiveiieithg eat P ays of the factors to a more stable position. What seems less con- 
IW. Qué woulde ort = specification error on the testing procedure discussed in Chapter 
doen e xpect the goodness of fit test for the number of factors required to break 
le arge samples, but if this point was discussed the reviewer did not notice it. 
Tem Puls e final comparisons on empirical data, the most interesting comparison is with 
awley's maximum likelihood method, using two sets of data: 
(i) the data used by Emmett with 9 tests and three apparent factors (sam 


" children) ; 
(ii) a battery of 33 tests used by Lord with at least ten apparent factors 
649 students). 
tremely well on these two examples, so that 


There is no doubt that the new method does ex y QUE 
as a ‘ working method ' the value of the new technique seems established. How will it 
‘The author himself says of 


compare ultimately with Lawley’s maximum likelihood method? 


this latter method (p. 129): 
“ This method is definitely the best available method for anyone who 


carry it through.” 


ple of 211 


(sample of 


could afford to 
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ie ei useful self- 
Thus the value of the new technique would seem at puo to lie vd dits od maid 
tain <imum- 
i those unable to embark on the full maxi i \ sing fo 
EE RR A ey i ld b d as a convenient starting point £ 
initial computation that could be use E eimi 
ku mien d i be assessed as a foolproof final proce u 
borious method. Before it can be as: d cream a 
bs SH eec further elucidation and discussion of the effects of the d ko ETE 
ect from the extra assumption would still appear to be needed. M.5. 


z ndon: 
Readings in General Psychology. Edited by P. Harmos and A. ILIFFE. Lo 
Routledge and Kegan Paul. 1963. Pp. x+251. 25s. 


sycho- 
The editors point out that the student may be introduced to the study of human psy 


a ondly, 
logy in two ways—first, by an elementary but systematic study of the m Min ok ore ey 
by an intensive study of half a dozen topics only; in issuing the present a oem ihe second 
they explain that their own aim has been to produce a textbook which 2 of (say) human 
line ofapproach. But would any teacher adopt such a procedure in the «t oc all fifteen 
anatomy and physiology? One great merit which the editors claim is th the subject 
» So that the student is introduced to aiye 
st American textbooks”. The papers ther ation 
There are admirable discussions of cerebral vini E 
by Lord Adrian, factor analysis and intelligence by Sir Cyril Burt, and the Pie “ores 
personality by Professor Vernon, an article by the late Dr. Ernest Jones on the 
mind’ (published over 30 ye i 


: . Ina 
ine for psychologists to preach to their students 


rather 
; then in such cases a man ought wou 
to choose death. Mr, Halmos apparently would say that ethics and pads ae 
advise him to choose the crime and so survive. J.P. 


T 64. 
Readings in Psychology. Edited by J. ConzN. London: Allen & Unwin, 19 
Pp. 414. 52s. 6d. 

This volume consists of twenty-four articles nearly all of w 
published, but have been revised for the Present edition, 
give students in this country a sample of the divergent views 
gists actively writing at the Present. Thus almost 
paper. The result is, as the editor 
extreme materialism of the followers of Watson and Skinn 
coin a phrase) of Professor Burt. 


unattractive style; the Papers by 
like Professor Mace 


. ly 
hich have been DAC 
The aim apparently has e 
of the leading English psy 


heir 
ch, 


psychology are represented ; and the seri 
in a logical and progressive order, AL 
produced and printed. 


P. 


Je 
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An index t 
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duc Rea neces ehe fourteen volumes of the British Journal of Statistical Psychology. 
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the Briti A 

to arah eme im Society wish to take this opportunity of expr 
Ts ar i 
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FACTOR TRANSFORMATION METHODS 

By D. N. LAWLEY 
Department of Mathematics, University of Edinburgh " 
ò and 
A. E. MAXWELL 


Institute of Psychiatry, Maudsley Hospital, University of London 


uch a way that the final 
n in which some of the 


een factors which, 
The methods 


ming factors ins 


th a given patter 
n is made betw 


(ii) uncorrelated. 


uu are described for transfor 

lenis war in reasonable conformity wi 

a heken - p tobezero. A distinctio 

areata sformed state, are (i) correlated and 
strated by numerical examples. 


J, PROBLEM 
because the matrix 


Much 
controversy amongst factor analysts has arisen 
i jon matrix 


of loadi : 

is d n derived from the analysis ofag 

may or us ue. The factors can be ' rotated within the factor ' space 5 

of ‘slum aie, be kept orthogonal (see [7], PP- 5-57 et seq.)- 

since this red o reduce to zero, or near Zero» as many as possible of the loadings 

facilitates i uces the number of parameters required to describe the data and 
nterpretation of the factors. Various empirical methods for achieving 


thi 
s end have been proposed of which the varimax method [5] is the best known. 
nal solution by rotating in such a way 


It achi e 
that, one a simplified and unique orthogo 
, for each factor, differences between loadings are maximized. If the factors 
Jated, then the promax method of rotation 
e hope is 


ar 
B oe to become oblique, or corre 
that a 5 employed. When these rotatio 
interpretation x obtained will be readily interpretable. 
of the va tion of factors depends ultimately on prior kno 
€xperim: riates being analysed, it has also been propose 
a facto enter should be asked to postulate in ? 
infi (i in which the posi he zer 
loadings ; Given this information, € 
is fien are available (see [7]; chapter 6 H 
Methods 2 iu desirable to start with fairly g° 
given i s of obtaining these, for both correla i u 
electr n [7], chapter 5; but as these methods are not Very easy to prog 
onic computers, more suitable methods are considered here. 
G 


S.P. 


tation proce 


lated factors, are 


ted and uncorre 
amme for 
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II. TRANSFORMATION TO CORRELATED Facrons 


We begin with a p xk loading matrix L, of p variates xi on k tome ^ " 
We wish to transform to new factors f;* such that the loading matrix L K dose 
has zero (or near zero) values for some of its elements. The positions o vs z 
zero values are determined by the experimenter who is asked to supply a A * 
“pattern ’ matrix Q—[gi;] in which postulated zero loadings are represente i x 
zeros and non-zero loadings by unities. The original factors fy are assume ae 
be orthogonal or uncorrelated but, in the first instance, we shall suppose that à 
transformed factors may be correlated. The problem is to find a k xk trans 
formation matrix M such that L*=LM has zero or small elements in o 
corresponding to zero elements of Q. M must be non-singular, and for L m 
M to be unique a necessary (though not sufficient) condition is that Q shoul : 
have at least (k—1) zero elements in each column. An iterative solution to the 


problem is first given, but it is then shown how a non-iterative solution may be 
obtained. 


To obtain a first approxim: 
column of LM is, when mul 
with the. corresponding colu 


ation let us choose M in such a way that each 
tiplied by a scaling factor, in maximum conformity 
mn of Q, in a Least Squares sense. This gives [1] 
M=(L'L)-(L'Q)p, 
where D is a diagonal matrix chosen so that 
P=(M’M)1 
We then have 
LL'—-L*M-WwM'A» — L*PL*, 
matrix for the transfor 
ation to M can be i 


has unit diagonal elements. 


Hence the correlation med factors is P. 


e process. 

, L, Dand P in the preceding 
i process. Let L*. be the matrix 

formed from L* by i 

element of Q is zero, To obtain a better 

chosen in such a way th 


: ; M is in maximum con- 
formity with the corresp 


o. This gives 
Mq = (L'L)(UL*, D, 
where Dy.) is chosen in the Same way as Dy). 
Further approximatio 


t ns may be obtained in 4 Similar manner. Defining 
L*,(s) in the same Way as L*,05, we have for 5-22,3,... Sequences of matrices 
Mis, L*(y, L* D isfyi 

6» ^» L^», Dis satisfying 


Mis) = CL LL ys_y)De, 
L*(— LM). 


These sequences Converge to matrices which we shall denote by M, L*, L*, and 
D respectively. We have finally, L*=LM where 


M-(LL)3(L/L* p, (1) 


if 


n 


— —————— a RR 
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III. NOoN-ITERATIVE PROCEDURE FOR CORRELATED FACTORS 
a es process just described can be simplified so that the same results may 
E. "rate without iteration. We shall show that, for each value of r, the 
ede en mr of M is the column vector corresponding to the largest latent 
ak ofa certain matrix Hr. Let us denote by Lr the matrix formed from L by 
da acing all the elements in the ith row of L (or the ith column of L^) by 
Q a whenever qir=0. For example, if, with p=7 and k=3, the rth row of 
{i 0 1001 1j 


then L', is of the form 


x0x00*x* 
x D x. 0x x 
x 0 x 0 0 = X 


where x’ 
re x's denote non-zero elements. 


mac 1*, and l*r be the rth column 


s of L* and L*o respectively. 


1*,=Lmr, 
If, 2bomr 


From equation (1) it is clear that mr is proportional to 
This is ecjtiotenta iteram (0 wg 
where H. i Hym;=Armn (2) 
r is the k x k matrix given by 
H,-(L'L)(L ibo) (3) 
bed in section II is 


and where A, is a latent root of Hr. The procedure descri 
thod of finding the largest latent 
neral distinct, 


mug equivalent to the usual iterative me 
and E matrix. Hence Ar is the largest latent root of Hr, in general P 
infu. is the corresponding column vector. It can be shown that if the rt 
(k~1) of Q has exactly (k—1) zeros then Ar=l. If there are more than 
near zeros, then O<Ar<l. In practice Ar 18 usually either unity or fairly 
unity. 
pri Equation (2) can be reached more directly by starting with @ different 
neiple. For each r let us choose m, in such a way as to minimize the sum 
hich correspond in position to Zero 


of s 
ele quares of those elements of 1*,=Lmr W 
ments of the rth column of Q, subject to the sum of squares of all elements 
e minimize 


of ]I*, 5 T à 
remaining constant. That 1s, w 
1*’, at pe rol* ro m'r (L'L-L/ r Lr)mr 


Subject to 
1*' r l*r= m’;(L'L)mr 


b H 
eing held constant. This gives the equation 
— us (L/L)ms- 0, 


(L'L-L': Ly)mr 
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where pr is a constant, and this is equivalent to 
(L': L;)m;=),(L’L)m,, 
where Àr=1—pr. Hence, pre-multiplying by (L’L)-1, we have 
H;ym;=A;m,, 
where H is as given above, by (3). 


Since rapid and powerful methods exist for finding the latent iani e 
vectors of symmetric matrices, there is an advantage in obtaining the vector ve 
by the following method. Let T be the lower triangular matrix with pe 
diagonal elements, such that TT’ =L’L, and let Wr be the matrix given by i 

W;-T-(L'L;)T^3, ( : 
Then Wr is a symmetric positive definite matrix having the same latent pun 
as Hr. Let uy be the vector corresponding to the largest latent root Ar. AP 
from a scaling factor the vector m, is then given as T’luy. . itrary 

Let M* denote a matrix in which the columns m, have entirely — ES 
scales. Let D be the diagonal matrix with positive elements such that dipl 
equal to the diagonal part of (M*'M*)3. Then the required transforma nal 
matrix is given by M=M*D. The matrix P=(M’'M)- has unit diago. 
elements and is the correlation matrix for the new factors. :kelihood 

If the original loading matrix L has been found by the maximum likeli : 
method (see [7], chapter 2), there is a considerable computational prid 
in substituting V-!2], for L throughout, where V is the diagonal matrix W i 
elements v; are the residual variances of the Xi, i.e. the components of varian 
not due to the common factors. With this method the matrix 


J-rL'v3L 
is made diagonal, and hence the W, matrices may easily be calculated as 


W.-pann ACA gu, (5) 


Apart from its scaling factor the vector my is given by J-1?u,, 


IV. ROTATION ro New ORTHOGONAL FACTORS 
If the new factors are to be orthogonal, L must be post-multiplied by a^ 
orthogonal matrix. We shall assume that the columns of Q can be ordere 
in such a way that, for r=1, 2, 


: +, k—1, there are at least (k—r) zeros in the 
rth column of Q. (The last colu 


r i mn need have no zeros.) 
In this case it seems most conv, 


enient to carry out the factor rotation in 
(k—1) stages. In the first stage we find Lı, W,, u, and m, as before. The only 
difference is that we now standardize T», so that m’,m,=1, We next construct 
an orthogonal matrix M,, 


of order k, with m, as its first column (see section V) 
Then rotate all k factors so that the lo 


à acto ading matrix becomes LM, The 9 
column of this, which is Lm,, is then the first column of L*, Now delete the 
first column of LM, and rename the resulting 5 x (k—1) matrix L. 


Y 


ee 
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With the new matrix L we calculate L, as before and hence find Wa, which 
is of order (k—1). We then obtain the vectors us and m,, each containing 
(k—1) elements. The latter is standardized so that m', m,— 1. Next we 
construct an orthogonal matrix M,, of order (k— 1), whose first column is m.s. 
This enables us to rotate all factors except the first to obtain a new loading matrix 
LM,. 'The first column of this, which is Lm, gives the second column of L*. 
The remaining columns of LM, represent the loading matrix of the last (k—2) 
factors at this stage. If k>3 the procedure is continued. 


At the rth stage of the process Land Ly are p x (k-r +1) matrices and Wr 
is a square matrix of order (k-r+1). The vectors Ur and m, each have 
(k—r--1) elements and mr is standardized so that m'r Mr= 1. The matrix 
M; is an orthogonal matrix of order (k—-r+1), with first column my, which 
rotates the last (k—r +1) factors. The rth column of L* is given as Lmr. 
At the final stage, when r—k— 1, the last two factors are rotated and LMx. 4 
provides the last two columns of L*. 


V. CONSTRUCTING AN ORTHOGONAL MATRIX wuosE First COLUMN IS GIVEN 


In this section we give a method of constructing an orthogonal matrix U, 
of order n, whose first column is given. The method is very simple to pro- 
gramme for a computer. 


We denote the rth column of U by ur and its mth element by umr: We 


define column vectors Zp, + ++» Zm each of elements, by 
z,-(0 1 0 ssa U 0% 
z,-(0 0 I awe 0 /05 
m={0 0 0 ... 0 1) 


We may suppose, without loss of generality, that the rows of U are so ordered 
that u, the first element of u,, is not zero or near-zero. This ensures that u, 


is not linearly dependent upon Zg, . - - » Zw OF nearly so. 

The vectors z enable us to construct without difficulty successive columns 
of U. Suppose that, for m> 1, the columns uj, . . . , Um-i already exist, and 
let u*m be the vector defined by 

m-—1 
u*m=Zm— Xj '"mrür (6) 
r=1 
Then u*, is orthogonal to uy, . ++» Uma since, for s « m, 


u'/gu*g — U'sZm — ms —U. 
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We have also 
u*' m u*g —u* m Zm —u*mm, 
where u*jm denotes the jth element of u*m. Hence the vector 
Um — (1/A/u*mm)u*m (7) 
may be chosen as the mth column of U since it is orthogonal to uy, . - 
and satisfies u’/mUm=1. 


As u, is known initially, relations (6) and (7) enable us to find successively 


Uy, +--+, Un. It may also be noted that, if 223, some of the elements of U are 
zero since, for 1<m<s, 


., Um-1 


m-—1 
U*ms=u*’ s Zm =u*’ s(u*m+ Y, umrur)=0 , 
r=1 


and hence also ums — 0. 


VI. A NUMERICAL ExAMPLE 
Transformation to correlated factors 


To illustrate the calculations we shall take L’ to be the matrix given in [7]. 


page 20, which was obtained by the maximum likelihood method of estimation. 
Its elements liry are: 


0-664 0-688 0:492 0-837 0-705 


0.322 0:248 0.304 -0:291 -0:314 -0377 0-397 0.204 0-428 
—0-:075 0-192 0-224 0-037 0.155  —0-104 0.077 —0-488 0-009 


The elements v; of the matrix V, i.e. the residual variances, are given by the 
formula 


0-820 0-661 0-457 0:765 


y=1- 5 Pir à 
r 
They are: 


0:4498 0:4283 0:6153 02134 0-3804 0:1747 0-3995 0-4666 02315, 
where, for example, 0:4498 =1 — 0-644° — 0:322? — ( —0-075)2, 


Since the loadings are maximum likelihood estimates we use equation (5) 
and find W,, W, and W, for a pattern matrix, with correlated factors, given by 


Liidt 1 o 1g 
V=|00011100 0 
LODO T i i 4 

The diagonal matrix J- L'V-!L has elements (14-9863 3-3649 0-8372). 
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We find that 
(mj) (mj (ms) 
0-470 0-526 0-311 1-000 0-431 0-507 
M= |0773 —0:977 0-148) ; P 0-431 1:000 0-137 
0-906 —0-106 —1:115 0-507 0-137 1:000 
The final loading matrix L*' is: 
0-493 0-689 0-699 0-202 0-229 (0-000) ^ 0-689 (0-000) 0-699 
(0-043) (0-099) (—0-062) 0:721 0-661 0-810 (—0-048) (0-005) (—0:017) 
0.338 (0-037) (— 0:052) 0-176 (0.000) 0-315 0.178 0-730 0-291 


M 


Rotation to new orthogonal factors 


In rotating to new orthogonal factors we change Q' so that what were rows 
2 and 3 now become rows 1 and 2 respectively, and row 3 now consists entirely 
of unities. W, is again found from equation (5). For W, it is necessary to 
use equation (4) with L’,V L, in place of L’, L, and with TT’ =L’V-1L, since 


the latter matrix is, at this stage, no longer diagonal. The rotation matrices 
are: 


(m) (mə) 
0-471 0860 0-196 
le i i) 
M,- |-0877 0481 0000| ; M,- [ 0-492 0871 


—0.095 —0-173 0-980 -0871 0492] 


Due to the change in Q’, the column m, here corresponds, with a different 
standardization, to mę in the correlated factor case. 


The final loading matrix L*' is: 
(0-037) (0-088) (—0:056) 0-646 0.593 0-727 (—0:044) (0-004) (—0:016) 
0-315 (0-053) (—0-014) 0-108 (— 0:041) 0-216 0-189 0-644 0-287 
0-671 0:749 0-618 0:597 0:515 0-501 0-750 0:347 0:328 
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TESTING DIFFERENCES BETWEEN 
RELIABILITY COEFFICIENTS! 


By WALTER KRISTOF 


University of Giessen, Germany 


In the following paper an attempt is made to derive a working formula, based 
on the method of maximum likelihood, for testing the significance of the difference 
between two reliability coefficients. It is assumed that both tests have been 
administered to the same group, and can be split into equivalent halves. A worked 
example is appended by way of illustration. 


J. INTRODUCTION AND PROBLEM 

When we want to decide whether two tests are equally reliable an adequate 
statistical method is needed. Since confidence intervals are available for 
reliability coefficients (Kristof, 1963), this decision can be made if each test is 
administered to a different group of subjects. But when the same group of 
subjects is employed twice, additional information is available and should be 
used. Accordingly we shall restrict ourselves to the case in which two tests are 
given to the same subjects. A significance test based on the likelihood ratio will 
be derived which will provide a method of testing the homogeneity of two 
reliability coefficients. The sample size N is assumed to be not too small. 

This approach treats reliability as an invariant property of the test and thus 
belongs to classical reliability theory which uses the concept of parallel measures. 
This concept is equivalent to the true-score-plus-error assumption. Accordingly 
we define reliability as that portion of the total variation observed which is 
attributable to the variation of the true measures, and disregard previous 
extensions of the reliability concept (cf. Burt (1955), Mahmoud (1955), 
Cronbach, Rajaratnam and Gleser (1963) and other writers). In particular we 
shall consider only one source of variation, namely, the persons tested. 

A further assumption is that each test has been split into two equivalent 
halves with equal variances. Scores on the halves will be denoted by x; and Xs 
for the first test, and x and x, for the second. Splitting tests into more than 
two parts will not be considered. We shall also assume that scores on the halves 
have a joint normal distribution. A test by Walker and Lev (1953, p. 190) 
may then be used to check the equality of the variances of the corresponding 
halves, A more adequate method, however, would be Votaw’s (1948) test of 


Compound symmetry. , 
It is convenient to perform a transformation of the variables: 
y= r t» Jac m (1) 
Ya = X3 +t Xo Ya = X3 — Ya. 
N 1 This investigation has been supported by the U.S. Office of Naval Research under Contract 
onr-2752(00). 
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vai " jance 
Let ej; denote the covariance of y; and yp. Then the variance-covari 
matrix will bet 


a, 0 og 0 
0 9,9 0 0 


2 
pip 93, 0 95 0 a 
0 0 0 O44 | 
with 015 = 05; and it will have the determinant " 
lec] 922044(911055 — 015). 


Let us denote the general element of the m 


atrix which is inverse to (uy) by 
o, It is easily found that 


oi 735 : (4a) 
211033 — 043° 

E 2 
O33 

g33— ?u (4c) 
911035 — O13" í 

o= t3 ,and (44) 
944 

Gia psa. 915 (4e) 


711933 — 045” 
These relations will be used later. Completely analogous equations express 
ajk in terms of ait, 


Let us now express the null hypothesis Hy in mathematical symbols. 


Since o5; represents the error variance of the first test and c,, of the second, the 


reliability of the first will be (931 — 953)/03; and of the second test (055 — 044)/ 039» 
reliability being defined as the ratio of true and total variance, Equating both 
reliabilities, we have 


Hy: 911044 — 053033 — 0; (54) 
and in terms of the o/s we obtain 


Hy: glgti — 922523... (5b) 


II. MaximuM LIKELIHOOD ESTIMATION WITHOUT RESTRICTION 

ly we resort to the Wishart distribution 
ts sjx as a basis for the maximum-likeli- 
hart distribution (the likelihood) is 


4 
N— 
exp {- olay (6) 


j, k=1 


hood ratio test. The density of the Wis 


where K is a constant not involving the oj,’s. 


T o here denotes variance and not standard deviation. 


r. x ——MÀ 
E AM P S 
—————— A 
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First we derive the maximum-likelihood estimators 6); of oje when no 
restrictions are imposed. The quantity to be differentiated may be written 


+ B 
g —n|ojxl =, x oF Sip (7a) 
or, in terms of the o#’s solely, 
4 
q=—In | o?*| jpk x gas (7b) 


In designates a natural logarithm. It is convenient to differentiate with respect 
to the o/*s rather than with respect to the ojjs. Thus we obtain in general 
aq 
a (2 — 84x) (ect ip) (8) 
E e 8j; is the Kronecker symbol. Setting these derivatives equal to zero we 
obtain 


Gy = Sik (9) 
For the sake of clarity let us write in detail 

63 =Sip (10a) 

65, — 52m (108) 

833 = 539 (106) 

63, — 54 (104) 

615—513 (10e) 


Thus the desired maximum -likelihood estimators have been found. 

An essential assumption of these and subsequent derivations is that the 
tests under consideration do not have very low reliabilities. In that case we 
need not be concerned about difficulties arising from the additional restrictions 


T22 S011 and 944€ 055; which are not implied by the Gramian character of 


(oy). 
III. Maximum LIKELIHOOD ESTIMATION UNDER Hy 
As a next step, maximum-likelihood estimators Gj, Of Ojk under the 
restrictive hypothesis Ho are required. Employing a Lagrange multiplier A, 
the quantity to be differentiated can be written 
4 

q= -In|e*|- 2X osp tÀ (oati — 009). (11) 

" jk-1l 
Setting all partial derivatives equal to zero (note g!3- g?!) 


with six independent unknowns: 


, we have six equations 


= Gy +5 EA 0, (12a) 
— 33-533 — 099 0, (12b) 
— õa ts — A9? — 0, (120) 
— G qq +544 HAG” =0, (12d) 
= 2613+ 2513=9, (12e) 
dila Tala a Un qan, (12f) 
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Since eqn. (12e) does not involve A, the result 

91570,3— 55 (13) 
is at once obtained. The remaining five equations determine the entire solution. 
Somewhat unwieldy cubic equations result for each essential unknown. Thus it 
seems to be computationally simpler to solve for one unknown, say 64, first, and 
then to find the remaining unknowns from recursive formulae. We will describe 
one possibility in what follows, other ways being equally feasible. 

We find 6, from the cubic 


2 
g, 3 Asa Sis" 2 4, $1183a(S11S44 7522555) + 2515 25154, 55,553) 
eS MAS 
S33 $5554 


eu 


Sasia (S2208 F Susta) _ 0 (14) 
4553544 


Then 63, can be obtained from 

fi $3385 (15) 
and subsequently 
z, — Sa8 +Sa0F 35 (16) 
is 26 
and finally 

Epp uri (17) 

93g 
Thus all àj;^s may be calculated from the data, Instead of eqn. (14) we 

may perhaps, for purposes of computation, use the more convenient form: 


` Sis S31$935; s 
643 — (sai 52-2288 Z 2s (2222 a oy 
S33 S44 S33 Sa 
S118138? (Soo S 
t (Bet) co, (18) 
Sa $n 

pirical correlation for the total tests, r say, and 
= 5415337", we may then write 
Žu’ = sall +r)? d ss (1-402) — (1-252, —1s5*5,--2-0. (19) 
Here the abbreviation — $35535/544 is used, 


If we introduce the em: 
bear in mind the identity s,,2 


Some remarks concerning the solution of the cubic will be in order. There 
is always a positive real root, as is easily i 


tuart, 1961, p. 52). To find the root 
different methods are available. We may proceed graphically, or we may use 


iterative approximation, gradually approaching the root to any desired degree of 
accuracy. For this purpose Newton’s rule and the “ regula falsi " might be 
helpful. Provided the coefficients in the cubic do not contain too many digits, 


Cardano's formula (see Burington, 1958, p. 8) can be used to find the root 
algebraically. 


a — 


 ————— 
——_—_—__ 
2 ————— 
TY 


Testing Differences Between Reliability Coefficients 109 


It is advisable to determine as many digits of the root as possible since even 
small deviations from the true value may seriously affect the whole solution. 


IV. Tue Lixetmmoop Ratio TEST 
The likelihood ratio for testing Hp is 


By sse 8&4) Lm. 44) 
Tes E , ai = > » 744. . 20 
n Daco Ou) Ly ++» fa) (2 
y means of eqns. (4) and (10) it is easily verified that 
4 
E Gs, =4. (21) 
j, k= 1 
Analogously we find after some ‘manipulation of eqns. (4) and (12), that 
4 
X Gs, =4. (22) 
j,k=1 
Thus the likelihood ratio becomes 
y-1 
je (y= l 23 
[özl (23) 


In accordance with the general theorem for the likelihood ratio, namely, that 
in large samples the quantity —2 Inl is distributed approximately as x? with 
the number of degrees of freedom equal to the number of restrictions imposed 
upon the maximization problem under Hi, we conclude that the quantity 


zp N N-2 
en (dt T 
M jk 
is distributed as y? with df=1; or, written out in fuller detail 
rd 3 — Sis") 
2—(N—1 poua r$ oM. (25) 
x= ) Soosua(SuSa3— S18") 


Using common logarithms (lg) and resolving the fraction, we may also write 


DN 
X —2:3026(N — 1) - [Ig 29+ Ig aa + lg (911633 —55) 

-lg 553 — lg Saa — lg(5523 — 13]: (26) 
putation. Thus the 


This is perhaps the simplest form for purposes of com 
o empirical reliability 


desired maximum-likelihood ratio test of homogeneity of tw 
Coefficients has been obtained. 

__ The foregoing derivation assumes that 
difference scores on the halves are available. 
Convenient to use the empirical variances o 
this case we may compute the required quantities 57i with t 
€quations 

(27a) 


for both tests the total scores and the 
Sometimes, however, it may be more 
f the totals and the halves only. In 
he help of the following 


- 2 
$1 7521422» 


$997 2(sz,* 4-522") —$z1422^) (27b) 
533 7 523424» (27c) 
544 — 2(sas? -- 524") — $28 :4^ (27d) 

(27e) 


S13 — 2-223131 TA) 
empirical unbiased variances and covariances being written in the usual fashion. 
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V. A NUMERICAL EXAMPLE . 
By way of illustration the method developed in this paper will be applied 
to numerical data taken from an earlier work by Lord (1957) T: . T 
Taking the test scores of N — 649 examinees the following covariance matri 
obtained: 
S 86-3979 57-7751 56-8651 58-8986 
57-7751 86-2632 59-3177 59-6683 
56-8651 59-3177 97-2850 73-8201 
58-8986 59-6683 73-8201 97-8192 
In the matrix the first two variables are parallel halves of a vocabularly e 
administered under very liberal time limits. The last two variables are paralle 
halves of a vocabulary test constructed So as to be as nearly equivalent as possible 
to the halves of the first test except that the time of administration was so short 
that only two per cent of the examinees completed each half. : 
From the above data the reliability coefficients of both tests are easily 
found. "They are ru® — 0-80, ru) — 0:86, the superscripts indicating the tests. 
We want to decide the question whether rj) and re) are significantly different, 
i.e., whether the time conditions have influenced the reliabilities. 
With the aid of eqns, (27), the matrix (sx) is determined: 


288-2113 0 234-7497 0 


UM 0 57110 9 0 
™ | 2347497 9 3427444 0 
0 0 O — 474640 


orresponding to a àj,— 
Next we find 


and " 

t= “2288 _ 412.4061, 
S44 

Now eqn. (19) becomes 


6,3— 448-99416,,24 70544-766,,—81 16553 — 0, 
The root of this cubic was found to be 


61, — 304-940, 
Then using eqns. (15), (16), and (17) the remaining djs were determined. 
Their matrix is 304-9400 0 234-7500 5 
" 0 50822  Q 0 
(m= | 2442497 0 3249193  Q 
0 0 0 54-1584. 


The entries corresponding to a ajk —Ü are placed equal to zero. 


T 1 am indebted to Dr. Lord for permission to use his data and for valuable advice. 
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Now we find 
9,1033 — 513^ = 43973-47 
and 
531333 — 513^ = 43675-39. 


Taking logarithms and using eqn. (26) we end with 

x?= 14-39. 
With one degree of freedom this value is significant at the P <0-02 per cent level. 
Thus it has been proved that the different time conditions under which the tests 
were! given do influence the test reliabilities, since the reliability of the second 
test is significantly higher than that of the first. 


REFERENCES 
Burincton, R. S. (1958). Handbook of mathematical tables and formulas. Sandusky, 


Ohio: Handbook Publishers. 
Burt, C. (1955). Test reliability estimated by analysis of variance. Brit. J. statist. 


Psychol., 8, 103-118. 
Cronpacu, L. J., Rayaratnam, N. and Geser, Gotpine C. (1963). Theory of 
generalizability; a liberation of reliability theory. Brit. J. statist. Psychol., 16, 


137-163. 
KrNpaLL, M. G. and Stuart, A. (1961). The advanced theory of statistics. Vol. 2. 


New York: Hafner. 
Kristor, W. (1963). The statistical theory of stepped-up reliability coefficients when a 
test has been divided into several equivalent parts. Psychometrika, 28, 221-238. 
Lorn, F. M. (1957). A significance test for the hypothesis that two variables measure the 
same trait except for errors of measurement. Psychometrika, 22, 207-220. 
Manwoup, A. F. (1955). Test reliability in terms of factor theory. Brit. J. statist. 
Psychol., 8, 119-135. 
Voraw, D. F., Jr. (1948). Testing compound s 
distribution. Ann. math. Statist., 19, 447-413. 
Watxer, Heren M. and Lev, J. (1953). Statistical inference. 


ymmetry in a normal multi-variate 


New York: Holt. 


Vol. XVII The British Journal of Statistical Psychology November 
i) Part 2 1964 
113—135 


j THE DETECTION OF CHANGE AND THE PERCEPTUAL 
MOMENT HYPOTHESIS' 


By T. SHALLICE 


University of Manchester 


. T his paper examines Stroud’s theory that the perceptual input is quantized 
in time (the perceptual moment hypothesis). A model of the detection of change 
based on the theory is compared with other models derived from statistical quality 
control methods; in particular those using simple and geometric moving averages. 
They are compared theoretically to see which entails the least computational 
load for the brain. Empirical comparisons are made with data from loudness 
thresholds, brightness thresholds, and the perception of causality: all cases in 
Which there is little change in stimulus intensity. The perceptual moment 
hypothesis is found to be the most satisfactory. Finally, some of the assumptions 
of the perceptual moment model are examined in more detail and the model is 


extended to deal with situations in which the intensity of stimulation alters 
greatly. 


I. INTRODUCTION 


| Stroud (1949, 1955) put forward the theory that “ with respect to input- 
output relations (of man) critically dependent on man's awareness of what is 
going on, . . . the most efficient description of the handling of these input-output 
relations is in terms of the psychological time T, which represents ¢ (physical 
time) in these operations . . - T is not a continuous variable.” ‘To put it 
another way, the brain processes information discontinuously in time, each 
q^ 


Operation lasting a ‘ moment * 
Although a considerable amount of evidence has been produced in support 


of this theory—see, e.g., Stroud (1955), White (1963)—two questions, which 


would appear to be very important when appraising it, do not seem to have 


m answered: (i) Could alternative theories based on the assumption that the 
rain operates in a continuous manner also provide a satisfactory account of the 


evidence? (ii) Why should the brain operate in this discontinuous fashion? 


The second question may appear incongruous, but it seems implausible that 


there should be no evolutionary or other biological reason why the brain should 


Operate discontinuously rather than continuously. In other words, there must 


be functional arguments which bear on this problem. 

Since most of the evidence concerns perceptual aspects of the psychological 
Process we will consider only the ' perceptual moment > hypothesis, i.e., that 
TR I should like to thank R. J. Audley for much advice and encouragement, and in particular 

uggesting the idea which became the framework of thepaper. lam also grateful to the Medical 
ut Council for a scholarship which supported part of the work 
S. H 
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sensory input is summated over discrete moments of vei is ie a weaker 
and more tractable form of the hypothesis of a psychologica moment. -— 
In order to provide a framework within which we can try to canter 
two questions we will adopt a functional and cybernetic approach—co ene 
theoretically how an organism can perform a simple but very necess 2 E 
'The task to be considered is that of detecting a change in the — 
analogous task to that of a quality control statistician trying to detect a ni 
in the quality of the output of a manufacturing process. This St 
approach bears certain similarities to the comparison of the human cup dene 
an ideal observer which has received prominence in Signal Detection d 
and also to the use by Stone (1960) and Laming (1962) of an optimal € 
decision procedure as a model for human performance in choice eieaa 
experiments. The similarity lies in demonstrating the economical and op cel 
properties of any means of carrying out a given function. Here, sev 
alternative hypotheses will be compared from this point of view. T 
The analogy with statistical quality control mentioned above was sugges s 
by Audley (1963). He was interested in how quickly an organism can dete " 
a change in the intensity of a stimulus as a particular case of the reaction pn 
situation. His model comprised a simplified artificial sense organ mee 
to a detector mechanism by, in the simplest case, one neural channel. S. 
Xr X2... Xm is the sequence of inputs which arrive at the detector in successive 
instants of time up to the mth, the detector has the function of deciding whether 
they should all be considered as samples from a common distribution representing 
the background illumination, or whether from some instant onwards they 
should be regarded as coming from a new and different distribution due to the 
presence of a signal to which the subject must respond. The detector is in 2 


cybernetically similar situation to that of the statistician 


engaged in quality 
control, who has to discov: 


er when faults occur in a manufacturing process by 
observing its output. In the manufacturing analogy, the quicker the change 


in output is detected, the sooner the process can be repaired. On the other 
hand a false alarm can be expensive. For the organism, the quicker a change 
in the environment is detected, the sooner the appropriate action can be taken; 
but again a false alarm wastes time and attention. We shall make the assump- 
tion that the schemes that statisticians have derived for quality control can 
provide us with a set of models of how the brain detects change which will 
have greater a priori likelihood of being correct than other models, since they 
have proved their value in a cybernetically similar situation, Some of the 


models entail a form of the perceptual moment hypothesis, others entail 4 
continuous processing of information, 


II. Tue Quatity CONTROL ANALOGY 

In a manufacturing process it is normall 

to calculate the value of a variable y;, 
output, xj. 


y possible at times ¢; (—1,2, - Md 
Which is related to the quality of t 


| 
| 
1 
j 
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Eo from which y; is drawn changes at any time, this indicates 
ipee 4 ES some, usually adverse, change in the manufacturing process. 
TE Sa at, e Mi ced distribution of the yi, it 1s possible to construct what 
E om ipaum chart (see Figure 1), from which it is easy to see whether 
8 eles a particular ym came from Y is less than a fixed small amount. 
fault "4 m he manufacturing process 1S examined since it is very likely that a 
E aa Da has occurred. The variable yi can be calculated in many 
A ays sts the actual observations xi. In practice, only a few ways of 
ie iia y a rom xi are used, each having virtues important in particular 

. For more details of quality control methods see Grant (1952) and 


Page (1954). 


ST represents the average acceptable quality of the 
control limits. Remedial 


e.g., the last point shown. 


F: à 
IGURE 1. A typical control chart. 
output. U.C.L. and L.C.L. are the upper and lower 
action is taken if an observation falls outside these limits, 


vide the bases of the 


statisticians, will pro 
s of them there are 


ee few methods, favoured by statistic : 
iei to be considered, but before going into the detail 
; general points which are relevant to the analogy: 
a 9 What corresponds in the brain to the statisticians’ observation? For 
the a the input is arriving continuously in time, whilst in quality control 
ea are almost always sampled at discrete intervals, e.g. 1n the 
ihe p of screws, batches of screws will be selected at particular places in 
dps al output, and their diameters measured. Some quality control methods 
rudis simply adapted to deal with continuously sampled material, others 
n " if a method can be so adapted we will do so for three reasons: to use 
lo 'ontinuous sampling method, when a continuous method can be applied, 
Ses information ; the brain seems, at least superficially, to operate continuously ; 

; 
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and finally it is better to I assumptions against the hypothesis being examined, 
in favour of it. n 

eae can to be two possible analogies to the statisticians’ dae 
These can be contrasted in terms of what happens to impulses ina single pec 
fibre. According to one notion there is a summation of the input in an e ben 
lator with a fixed time-span or rate of decay. The second, inherently » a 
tinuous, uses as the variable the length of the interval between two iu cwn 
the principle of Pulse Interval Modulation discussed by MacKay and oe as 
(1952). We will discard the second possibility for reasons given in the d 
sion, but basically because it would impose a much greater computationa ue 
on the brain. Proceeding with an accumulator model, we shall make a furt “a 
assumption that in order to deal with the perception of movement a page 
averaging process takes place in the accumulator. Again a fuller discussion z 
this point will be given later, but basically the reason is to lessen the jac 
computational load. By a ‘ spatial averaging process’ is meant one in which 
the output of the accumulator contains only the average position of an object, 
and no further details of the transient positions it was in during the time-span 
of the accumulator. (Throughout the paper the length of time that information 
takes to reach the accumulator from an object will be ignored—in the cases to be 
considered it is constant.) 
(ii) There seem to be two perceptual situations for which the analogy 35 


suitable—the judgement of change and the perception of change. That the 
two are different is illustrated by the experiments of Grindley (1936) and Drew 
(1937). They gradually increased or decreased the intensity of a stimulus. 


When the subjects reported a change they made one of two types of response. 
Sometimes they said they perceived the change itself, occasionally not even 


knowing which way it had changed. At other times they said that they knew 
the stimulus had changed, but had never perceived it changing. An everyday 
example of this same dichotomy is the difference between the detection of the 
movement of the second hand of a clock and that of the hour hand. 
One important difference between the two sit 
of change requires that the subject be concentrati 
perception of change usually does not. 
of change comprises an important fac 
of the environment which is not bein 
normally necessary for the organism to 
The functions of the two types of 
of change, change may take place alo 


uations is that the judgement 
ng on the stimulus, while the 
In fact it seems likely that the perception 
tor in shifts of attention: if that part 
g attended to does not change, it is not 
shift its attention to it, 

detection are different. In the perception 
ng many different dimensions, and it 15 
especially important to detect large changes quickly, For the judgement Lg 
change only a few dimensions are relevant and accuracy is as important as speed. 
These different requirements will pro 


bably lead to different types of mechanisms- 
This paper will be primarily concerned with models for the perception of chang? 
which will be treated as a process which detects change for the perceptual 
mechanisms mediating recognition and shifts of attention. 


n 
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- ey quality control system can provide the basis of a model for the 
hte ain perceives change. One of the models which has the most 
likely to b d ain for storage and computing space is presumably more 
a e m e correct one, since it would be likely to have evolved or be 
Eie dba "e capacity of an organism. For instance, some models 
Iuios-dis a the incoming data be analysed along separate dimensions 
ese aes y can be investigated. Others treat them in an unanalysed form, and 
omoia m much more likely to be found since they require so much less 
uting space. 

T ra quality control problems the statistician has a fixed standard against 
totes cg each observation. The functionally corresponding neural 
čomplex ich we shall call the Change Detector, must deal with a much more 

x position, since it must always be creating a new standard, at least on 


eve : i 5 
ry occasion when a change 18 detected. Also it must allow for the changes 


in i ea 4 
nput due to movements of the organism itself, which are of no use for 
standards must be created 


eo changes in the environment. Hence new : must 
Chinas y. How the new standards are created is not a vital issue when 
the ‘hid the different models, so this question will be taken up more fully in 
of the co together with its relation to the classic problem of the Stability 
inn isual World. However, one point will be mentioned which is more 
lator SN ni relevant; the standard must be based on the output of the accumu- 
"his is east a certain time before the output with which it 1s being compared. 
necessary if change is to be detected at all. 
mo Ed It will be assumed, until disproved, that one model is applicable for all 
thien na except those where there is any autocorrelation 1n the input, since 
the analogy with Quality Control 


rul breaks down. This, in particular, 
tid ata the consideration of the perception of changes of sound quality for 
es of high or medium pitch. 


s III. THe MODELS p 
TE ^ erceptual Moment Model In the simple control chart method one 
ofa 2 E= hey each observation forms the variable which is used as the P 
m pecus The obvious way of creating à model is to choose as the variable 
the e output of the accumulator at the end of each perceptual oa 
E cA being cleared after each output. (i might then a8 
obs esponding to the number of impulses that have arrived from a sm number 
of pde elements.) The standard will presumably be created from the output 
Trt S accumulator (or perhaps the Change Detector) of the previous moment. 
"" s model the entire input need not be analysed into dimensions before it 
fu ches: the Detector, and. for this reason it would not seem to require any 

mplex neural system. i 


d (ii) Moving Average Model Whilst the simple control chart is good for 
etecting those faults in a manufacturing process which result in a large change 
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in the average output, &, it is not so good at detecting a small change in X or a 
slow trend away from the standard. A more sensitive test is obtained by putting 


ni 
N= > Xr, 
r= n(i-l1)a1 


but this does not lead to a new model, since it is equivalent to making the disen 
periods of accumulation larger. A slightly more complex test considers runs 0: 
trials in which the variable lies on one side of the standard. This is inherently 
discontinuous, and difficult to adapt to a brain model. It has certain similarities, 
but no advantages over the next type to be considered—the moving average 
model. 

In the moving average method we make 


n= > Xi—r. 


r=0 
If this method is not to depend on the integration of input over perceptual 
moments it needs to be transformed into a continuous method in the form: 


T 
p= | Xe dt. , 
T-P 
Where x; —1 if a pulse arrives at time ż 
=0 otherwise, and P is the period of the moving average. 

The difficulty with the Moving Average Model is that the actual instant when 
each pulse arrives has to be remembered for P units of time, so that the value 
of each pulse can be subtracted from the accumulator after it has been stored 
for that period. One possible way of avoiding this difficulty is to use an ‘ over- 
writing ’ method in which the input is put on to the neural analogue of a rotating 
store, which is rotating with period P. The contents of the rotating store would 
be continuously summed, This would probably require that the input from 
a particular nerve fibre would go to a different place depending upon the phase 
of the moving average cycle, and an ‘ eraser’ should exist which would clear that 
part of the store just about to be used, This possibility will not be more fully 
explored here, since the important point is that a moving average model would 
have to be much more neurally complex than the perceptual moment model, 


and so, other things being equal, would be much less likely to be found in the 
brain. 


(iii) Geometric Moving Average Model (G.M.A.) 
gested by Roberts (1959), uses a geometric moving aver: 
for detecting change is 


Another method, sug- 
age so that the variable 


oo 
Xe D Nir, (<1), 
r=0 
In the present context it is much more n 


s atural to make the model continuous 
and consider 


sen [inta 


0 
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An important feature of this model is that: 


T+DT 
yes P? ye | x, dt — e, 


Where 0 « e « (1 — ADT) when an impulse arrives in the interval from T to T -- DT, 
and otherwise «=0. As DT50 the maximum error ->0 and the number of 
times the error occurs remains constant in any given finite time. So the effect 
of the errors, e, —0 as DT 0. 

This model corresponds to one with an exponentially decaying accumulator 
fed by a discontinuous input. It requires as little computing space as the 
perceptual moment model and seems very plausible neurally, being similar to 
many psychological theories of brain function. 

(iv) Sequential Sampling Model Page (1954) discusses the quality control 
methods considered so far, with the exception of the G.M.A., and explains that 
as they are based on only a limited number of the more recent observations they 
do not make use of all the information obtained. He suggests that it would be 


better to use a scheme based on sequential sampling. 


He defines the statistic 
nn 
Sa- x (x — E), 
i=l 
where E is the standard, and quality control action is taken if $,— min Sizh 
[e 


and a similar test is needed 


(a constant). This will only detect an increase in Xi, 
do these tasks together. 


to detect a decrease. "The other tests So far described 
If we were to base a model on this test it would be necessary for the stimulus 
input to be analysed into dimensions before the detection of change along each 
dimension could take place, in order that the value of the minimum could be 
ascertained. This makes it totally inferior as 2 model for the perception of 
change when compared with models where the raw input can be tested. It 
also seems to be inherently discontinuous, so to neglect it will if anything count 
against the perceptual moment hypothesis. While the above objections will 


allow us reasonably to ignore it as a model for the perception of change, they are 


much less cogent if it is advanced as a model for the judgement of change. In 
hat proposed by Stone (1960) 


fact it then gives rise to a model very similar to t Le E 
and elaborated by Laming (1962) for the description of choice reaction time 
phenomena. 
Theoretical Assessment The aim of this section is to provide an assess- 
ment of the a priori odds in favour of the rival models for the perception of 
Change. ‘The sequential sampling model will be ignored from here on, since 


its prior chances seem very low. Of the other three, the moving average model 
15 considerably more complex than the other two, which must count against It. 
The odds on the other two are roughly equal although the perceptual moment 


model has the advantage that, unlike the others, it provides information about 
the magnitude of the change as well as detecting change. 
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Comparisons of the speed and accuracy of the three tests depend pee 
value of certain parameters; length of the moment or moving average, m ie 
of decay of the G.M.A. It seems that for comparable accuracies and e ü 
detection of large changes the moving average is the fastest and the = aE 
the slowest. However, since the speed of all systems can be increase bel 
changing the parameters it seems unlikely that the small advantage of the e 
Average is enough to compensate for its much greater complexity. For me p 
change the perceptual moment is probably fastest and for small changes 
G.M.A. «c 

These a priori considerations seem to make the perceptual moment sig y 


more likely than the G.M.A., and both considerably more likely than the moving 
average. 


IV. EXPERIMENTAL EVIDENCE 


Before discussing the experimental evidence there is one major point e 
needs to be considered—the values of the parameters of the models. It wil 
be considered in the context of the length of the perceptual moment (D), but 
these arguments presumably also apply to the other models. , 

In the literature there is no agreement amongst the different theorists 
about the length of the moment. The theorists who connect it with the alpha 
rhythm (Walter, 1950; Wiener, 1948; Murphree, 1954) consider it to be about 
100 msec. White (1963), on the basis of subjects’ estimates of the number of 
stimuli in a rapid sequence, deduces that it is about 80 msec. Ansbacher (1944), 
using the Brown Circle Illusion, deduces that it is about 55 msec, a value quite 
close to the one we will shortly obtain using Michotte's (1963) data on the 
perception of causality. If these experiments are comparable, then it seems 
that the moment length must be variable. Stroud (1955) agrees with such a 
notion, giving among his postulates the following: 

* (IV) 0-05 « D «0-20 seconds approximately. Generalization (iv) is 
based upon experience... 

(V) tg 5, ...t» (the vector of moment boundaries) is frequently 
determined by singularities in f(t). I have often found cases where 
assuming that D constant didn't make very good sense—while simple 
assumptions of synchrony between special point values of the input function 
and the dates tọ 4, . . ., etc., did produce good explanations of the sort We 
are now considering." 
If the moment length does change, then an obvious candidate for a factor 

influencing the length of the moment is the intensity of stimulation. If the 
intensity of stimulation is increased, then the rate at which impulses reach the 
accumulator will also increase. Hence the number of impulses which wil 
provide an adequate sample for the detection of a change with the same false 
alarm rate will be reached in a shorter time. So the length of the moment can be 
decreased. Empirical support for such a decrease in the length of the moment 


q 


| 


i 


b 
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is that C.F.F., optimal apparent movement, two-flash threshold and the critical 
period of the Bunsen-Roscoe Law are all greatly affected by a change in the 
intensity of the stimulus. Since all these phenomena are connected with 
‘change’ it should be expected that they are explicable by the present theory of 
the perceptual moment. 

, Assuming that moment length is some function of the intensity of stimula- 
tion, then when the level of stimulus intensity changes rapidly the moment 
length will have to adapt itself to the new level of stimulation. How this might 
be done is a complex problem, and it will definitely affect the predictions that the 
theory of moments makes in any situation where the intensity changes rapidly, 
such as White's (1963) countability experiments. Since the parameters of the 
other two models are presumably also affected by intensity, the simplest way to 
discriminate between the models is by using experimental situations in which 
no great change of intensity occurs. ‘Three such situations will be examined 
below. The only other known to me—the Brown Circle Illusion examined by 
Ansbacher (1944)—does not seem to favour any one of the models. 


(i) Loudness Thresholds for Low Tones . 
If there is autocorrelation in the input, then the analogy We have considered 


Would seem to be inadequate since there is an extra source of information in the 
input which is not being used. This would mean that more efficient methods 
of detecting change should be available. On the other hand, a device searching 
for possible periodicities in the input could detect only a limited range of fre- 
quencies, The ear is a device of this sort with the basilar membrane acting as à 
periodicity detector. Yet it seems likely that at low frequencies (less than 
300 c.p.s. according to Licklider, 1951) pitch is identified principally by 
differences in the frequency of neural volleys to the brain and the effect of any 
autocorrelation detector becomes unimportant. Hence our models are relevant 
to perception of changes in these low tones. 

It might also be wondered whether absolute thresholds should be accounted 
for by a model of the perception of change. However, Bekesy, whose evidence 
we will use, says: “ In successive trials the sound pressure from the thermophone 
was reduced by steps of about 10 per cent, and the frequency was slowly raised 
automatically, starting from 2 c.p.s., until an auditory sensation was aroused. 
What Bekesy has called the arousal of an auditory sensation must necessitate 
the perception of a change. i 

Stroud has already used the nature of the threshold/intensity curve as 
evidence for the theory of moments, using Bekesy’s (1936) discovery that the 
threshold intensity for tones of low frequency, when plotted against frequency, 
gives a step function (see Figure 2). Stroud states that “ the moment train 
should ‘ beat’ slowly against the spontaneous frequency of the D's, thus 
maximizing the likelihood of its being detected at the following frequencies: 


1 
2D' * , > ; a , etc.” He fits Bekesy’s results with D =106 msec and predicts 
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that the steps should occur at the following frequencies 4-7, 9-4, 18-8, 28-2 and 
37-2 c.p.s., which agree very well with the observed frequencies of 4-47, 9-18, 
18:3, 28-2 and 38-2 c.p.s. ' 

To relate the data to the models, we will recast Stroud's explanation in 
physiological terms. It is known that a pure tone of less than 2,000 c.p.s- 
produces a volley of impulses in the auditory nerve at about the same phase in 
each cycle, varying only over a range of about 0-13 msec (Davis, 1951). Now 
the number of impulses per volley, V, will be related to the sound pressure of 
the tone, P, by some expression like V = V(P, F), which will not depend critically 
on F, the frequency of the tone. 


8 


3 
o 
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Ficure 2. Loudness threshold curve at low frequencies (from Bekesy, 1936, An. Physik» 
26, 554-566). 


Consider the performance of the perceptual moment model as the frequency 
of the tone is gradually increased. When the period of the tone is greater 
than D msec the number of volleys arriving in a moment can never be greater 
than unity, so that the maximum possible number of impulses per moment will be 
V(P, F). When the period is just less than D msec, occasionally there will be 
two volleys arriving in one moment, so that the maximum number of impulses 
per moment will now be 2V(P, F). For detection to occur the number 2 
impulses per moment should exceed some constant, so that as the period decree 
through D msec the threshold sound pressure will have a step. ‘There will i 
similar steps at 2D, 3D, 4D. ‘These will be decreasing in size because the € : E 
of an additional volley becomes proportionately smaller. The Moving Averas 
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Model will predict similar steps by an almost identical argument. The G.M.A. 
model, being inherently continuous, seems incapable of explaining the steps. 
The argument could have been made slightly more rigorous by considering 
Q, the frequency of hearing, but the extra complexity of the argument brings 
no extra reward. ‘The conclusion is the same. 

Stroud's ‘ beating’ theory did not explain the steps Bekesy found at approxi- 
mately 6, 7:5, 11, 14, 22 and 32:5 c.p.s. (Figure 2) which are smaller than the 
main steps. In point of fact these corroborate the moment theory, as it has 
been shown by Wever, Bray and W. illey (1937) that at low frequencies there are 
normally 2 or 3 volleys per cycle, the smaller ones being seemingly triggered 
off by the higher harmonics produced by the ear. 'These would produce small 
steps in threshold between the larger ones by an extension of the same argument. 

It seems that a model which produces some type of discontinuity in the 
sampling of the sensory input is very strongly supported by Bekesy's results. 
Hence the G.M.A. model becomes unlikely. 


(ii) Brightness Thresholds 

The usual explanation of the breakdown of the Bunsen-Roscoe Law for 
brightness thresholds (IT — for T < Te) was that temporal quantization occurred 
at the receptor level either photochemically or due to a fixed neural integration 
period. This period is triggered by the first quantum absorbed and persists 
for some critical duration, during which the number of quanta absorbed are 
counted, and a response is subsequently produced which is in proportion to 
this number. For various reasons this explanation seems to have gone out of 
favour and a more continuous view of the activity of the receptor is now envisaged. 
Mueller (1954), Johnson (1958), Boynton and Siegfried (1962) and Blackwell 
(1963) have put forward rather similar theories from different experimental 
approaches. For example, Boynton and Siegfried support the theory that 
“ Every element of stimulus clicits after a latent period, a tiny element of res- 
ponse; the gross response to a stimulus is the sum of the elemental responses 
to each elemental component of the stimulus.” co . 

If this theory is correct, then as Boynton and Siegfried point out, the 


temporal quantization implied by the Bunsen-Roscoe Law must come at a higher 
level of the nervous system than the receptor, and one of the detection models 
We are considering would be an obvious candidate. The discussion given below 
of how well the three models fit the data will not be rigorous because of various 
difficulties encountered in this field of study. One of these arises because at a 
given background and area of flash the chance of the flash being seen, Q, is 
affected by two stimulus variables—the length of the flash, T, and its intensity, 
1, and also by a host of subject variables of which the best known is the non- 
random pattern of subjects’ ‘ yes ' and ‘ no’ responses (for references see Bouman, 
1961). Another reason is that the three models would require computer 
Simulations before their behaviour could be accurately assessed. However, 
two approximate predictions can be derived from the models. 
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The first of these concerns the relation holding between T and : epee = 
f O. The G.M.A. model, in which the input of each impulse i E 
s xi itor is treated as a step increase, is extremely difficult to handle matl 
ee call 4 However, by treating the input as continuous, a fair S aimes 
CE os PE can be obtained. Let the momentary level of the eae À 
be g(t), the rate of input into it be a (this will be proportional to the mie e 
stimulation), and the rate of decay be proportional to g(t), the consta 
i ity being b. 
proportionality g Tien Gitka 
s bg=a—K et, 
where K is a constant depending upon initial conditions. 
In the steady state g=a/b. J 
Now suppose the rate of input changes stepwise at ż=0 from a to s 
Then for ¢> 0, 5g —4—(4.—a) e~, since when 1—0, g=al/b. Let the input be 


N additional photons arriving randomly over T seconds (“.N=IT), then 
T .(A-a)-N. 


~- b. [s(t)]] -5 . (T) - a zu = eT), 


max 


N-TJ[(1— e-^7), 
This is, however, a very poor approximation to the actu 
(This is demonstrated i 


are difficult to obtain, b 


oretically predict is the relation 
between N and Q for fixed T. This is; practice very difficult to obtain; but 
for the perceptual moment model, if the re 


is known, it is reasonably easy to deduce th 
T. Brindley (1960 D) states a theorem, proved in Brindley (1960 a), that “ If the 
flash is long compared with D, a relation of threshold to duration of the form 
TI" =C implies a frequency of Seeing curve of the form Q=1-e-" where k is 
the positive constant [7 2:(1 =O 1/02" He continued: * The deductions 


Bouman 


* Symbols changed to conform to those used earlier in this paper. 
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100 msec to 5sec. The corresponding frequency-of-seeing curves fit the 
theoretical relation Q-1-e- very well" (p. 192). Hence the perceptual 
moment model receives some support. 

'The brightness threshold results are not very conclusive, but taken in 
conjunction with those emerging from the study of loudness thresholds previously 
discussed they make the G.M.A. Model implausible. However, they do not 
greatly help in deciding between the other two models. 


(iii) Perception of Causality 

In Michotte's (1963) book on the Perception of Causality, he describes a 
large number of experiments in which the subject sees a slit containing a red 
square, known as ‘ object A’ and some distance away a black square known as 
“object B’. Object A moves along the slit at a constant speed and stops when 
touching object B, after which object B moves off at a possibly different constant 
speed, and then stops. Various factors such as the speeds and sizes of 4 and B 
are varied, and Michotte was interested in whether an impression of causality 
is reported by the subject. 

One of the factors in which Michotte was interested was what happened 
when an interval was introduced between the end of A’s movement and the 
beginning of B’s, the two objects being in contact during the interval. Michotte 
describes three phenomenological stages in perception as the length of the 
interval is increased. They are the impressions of ‘ direct launching’, ' delayed 
launching ’ and of ‘ two independent movements °. Launching is the name for 
the impression of one object ‘ bumping into’ another and setting it in motion. 
Michotte (p. 92) describes the three stages as: ‘‘ In the first stage we have the 
familiar Launching Effect. At the second stage when the interval is greater, 
the causal impression is still unmistakable, but the Launching Effect involves 
some 'time-lag'. Object B * sticks’ to Object A, its departure takes place 
only after some delay. At the third stage, however, the causal impression 
disappears and is replaced by an impression of successive movements of two 
objects which form a ‘ whole '—one which is loosely integrated, there being no 
internal links ". . 

In order to explain this phenomenon in detail, we will use Michotte's 
theory of the Perception of Causality as a starting point. Although Michotte's 
theory is presented in phenomenological terms, there is no great difficulty in 
translating the arguments into terms congruent with the approach adopted here. 
The theory of the origin of the Launching Effect is based on many ingenious 
experiments, and is that: “ At the moment of impact, the movement of the 
motor object (Object 4) appears to extend to the projectile (Object B), bringing 
about its displacement in space. This amounts to saying that from that point 
on the movement presents a double aspect; we see it both as a continuation of 
the movement of the motor object before the impact, and as something which 
brings about a change in the position of the projectile " (p. 140). This ‘ exten- 
sion’ of the movement of the motor object on to the projectile is called 
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by Michotte the “ ampliation ” of the movement. One of ean am 
conditions for the impression of causality to occur that Michotte de a is 
his theory is that there must be continuity between the two sog aie ee 
our present purpose this means that information that movement is 


must continually be signalled by the Change Detector for launching to be 
perceived. 


In terms of the perceptual moment 


model this implies that at each moment 
during the trial, movement, either of 4 


or of B, must be signalled by the Change 
Detector. Hence the average positions of both A and B must not be the same 


for two successive moments, If they were the same, no movement would e 
detected for either A or B for the second moment so that “ ampliation E 
movement " would not take place and the phenomenological impression O 
two independent movements would be produced. Ep 
Let P be the time during which A and B are in contact. Then, if 


contains two whole perceptual moments, the average position of both A and B 
will be the same for each of th 


€ two moments. Assuming that the phase of the 
moment train and the beginnj iod of contact are not correlated—a 


D when 2D <P< 3D, 


1 when P>3D, and 


0 otherwise, 

If P contains only 

4 movement of either 

satisfied and perceptio; 
A and B will be i 


will arise, 


ings ab 


distinct data ” (see p. 135). On the present 


is added to the input in the Ch 


if2D <P <3p, and 


otherwise, 


| 
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If P contains no whole moments, then normal direct launching should be 
perceived. The chance that this occurs is 
1 if P<D, 
Po if D« P «2D, and 
D 
| 0 if P> 2D. 
i 


POSITION IN SLIT 


TIME 


MOMENT 


Ficure 3. Perception of Causality according to the Perceptual Moment Model. The 
vertical lines are the boundaries of successive moments. The two other lines 


represent the physical positions of the objects, A and B, in the time about the period 
of contact. ‘The small squares represent the average positions of the objects during 
the moments. In the moments labelled M4, movement of object A is detected, and 
in those labelled Mg movement of B is detected. The case illustrated is an example 
of delayed launching since the average positions of the two objects are in contact 
for one moment and there is no break in the detection of movement. 


If we compare these predictions with the results of Michotte’s Experiment 
29 the fit is extremely good (see Figure 4). Since the graph is the average of 
three observers, who will have different values of D, the flattened peak of the 
delayed launching curve is to be expected as are the tails of the other two curves. 

The moving average model makes a qualitatively similar prediction to the 
perceptual moment model in that it predicts three stages: when the detection 
of movement is discontinuous; when the detection of movement is continuous, 
but A and B are perceived in contact; and when detection is continuous, but A 
and B are not perceived in contact. However the predicted time relationships 
are not those found empirically. If S is the time span of the moving average, 
and L is the time in which the standard is formed, the average position of A 
does not become constant until a time S after A has stopped, and even then, 
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movement of A will still be detected for a further time L. . On the other us 
as soon as B moves, its average position will change and its movement ra a 
detected. Therefore, we would expect direct launching if 0<P<S, bes vL) 
launching if S « P «(S--L), and two independent movements if P>(S+ à 
Now L is a variable which may not be constant, even in theory. Not enoug 

has been worked out about the creation of the standard to make any firm 
predictions about this aspect of the models. However this is not crucial, pe 
the boundary between direct and delayed launching does not depend on L bu 
only on S, which should be constant in theory. In order to fit the moving 
average model it is necessary to assume that Michotte's three subjects ue 
widely different and variable values of S. Hence the moving average x 
provides a much less satisfactory explanation than the perceptual moment model. 


182 millisec 

FIGURE 4. Average results for the three subj 
Michotte, A., 1963, The Perception 
line—Direct Launching; 
Two Movements. 


ects of Michotte's Experiment 29 (from 
i of Causality; London: Methuen). Dotted 
Continuous line—Delayed Launching; Dots and dashes— 


A further corroboration of the perceptual moment model comes from 
another strange finding of Michotte’s, 


He says: “ It is worth noting that the 
observers very often mentioned that the Launc 


hing Effect was ‘ better’ in cases 
where there was an interval of 30 to 40 msec at the point of impact than in cases 
where the second movement followed immediately, This must certainly be 
attributed to the length of time required for the ‘ rise of excitation’, i.e., the 
length of time necessary for the observer to receive a fully developed sensory 
impression of Object A after it has halted at the 


J centre. Indeed when the 
intervals are very short or non-existent, observers often have the impression that 


the two objects do not meet at all, there being neither contact nor impact” 


EY 


The Detection of Change and the Perceptual Moment Hypothesis 129 


The explanation that will be put forward here does not contradict Michotte's 
but is at a different conceptual level. On the perceptual moment model the 
movement of an object is detected both in the moment an object stops, and, 
paradoxically, in the following moment because its average position in the two 
moments is different. Also, when a movement starts, it is detected in that 
moment. Hence, if there is no gap between A's movement and B's, B will be 
perceived as moving, before A stops moving so that the impression of no meeting 
and no impact is natural. However, when B starts moving in the moment after 
A stops, this does not apply, and since all the other conditions for a good 
launching situation hold, the Launching Effect is seen as ‘better’. On the 
moving average model, A appears to move for (S+L) msec after it actually 
stops, whilst B appears to move almost immediately after it starts. (As in all 
this explanation of the perception of causality, the threshold for movement 
detection has been ignored. Introducing it only complicates the theory, but 
does not lead to any significant alterations in the conclusions that can be drawn.) 
Consequently in all cases where launching is perceived, B starts moving before 
A stops, and in all the Direct Launching cases there should appear to be no 
contact. So the perceptual moment model is even more strongly supported. 

Michotte’s numerous other experiments could also be discussed, but to 
deal with them in as much detail as we have dealt with the present experiment 
would lead to a very lengthy paper. The main elaboration necessary would be 
a more precise specification of the threshold for the detection of change. 
This would be particularly relevant to the experiments in which object A and 
object B moved at diferent speeds. Superficially, at least, there does not 
seem to be anything in the other experiments to alter the conclusion of the 
present analysis, that the perceptual moment model is much the most plausible 
model, since the G.M.A. model would provide an explanation that was very 
similar to and as inadequate as the moving average model. 


V. DISCUSSION 

'The one other situation, known to the writer, which satisfies the condition 
of no large change in the intensity of the stimulus is Ansbacher's (1944) work on 
the Brown Circle Illusion. However, all the models can explain the pheno- 
menon. This leaves the perceptual moment model as superior to the moving 
average model empirically and theoretically, and far superior to the G.M.A. 
model empirically. "Two further issues will now be raised. First, a closer 
examination will be made of some of the assumptions common to the three 
models, Then consideration will be given to the way in which the perceptual 
moment model can be adapted to deal with situations in which a sharp change 
!n stimulus intensity occurs. 
.  () The common assumptions ‘The first assumption of the present thesis 
is that the basic units for the detection of change are molar, not molecular, 


that is an accumulator model is preferred to one based on pulse interval 
S.P. I 
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1 
modulation (P.I.M.). Apart from the functional argument that a Meere 
would impose a much greater computational load, especially with : -— 
changing constantly due to motor movements, Barlow (1961) pon E iar 
there is physiological evidence (Fitzhugh, 1957) that what matters is th P a ee fase 
number of impulses in a time interval which is long in comparison wit : cd 
pulse interval. The only case known to the writer where P.I.M. has ee d 
in an explanatory model is by Kelly (1961) for flicker fusion (C. a 
The writer has recently shown that this model contains logical RE "s 
which can only be removed by dispensing with the use of P.I. M. (Shallice, 1 v 

The second assumption is that a spatial averaging process of sorts he "i 
place in the accumulator. If no spatial averaging took place, a moving o s 
would be represented in the accumulator by the distribution of all the panan 
it took during that moment, and more importantly a stationary object would a : 
be represented by such a distribution if the eyes were moving during the x: pisi) 
In order to detect that the stationary object had not moved, a standard woul¢ 
have had to be created which mirrored that distribution. Obviously to create 
the proper distribution for the standard is a much more difficult task than 10 
create simply the average position where an object should be found. Again 
we use the idea that introducing a spatial averaging process will greatly reduce 
the computational load later in the total system. The physiological counterpart 
to averaging is probably lateral inhibition, and the best psychological evidence 


comes from the stud 


y of apparent movement and Ansbacher's (1944) work on 
the Brown Circle Illusion. 


One part of the model which has remained relatively undeveloped is how 


the standard is created. The reason for this is that it did not seem of vital 
importance when comparing the models. 


problem to the old problem of the Stabili 
standard will correspond to what Gregor 
eye/head system, while the input will corre 
retina system. Gregory put forward his 


Helmholtz’s, as an alternative to MacKay’s (1958) theory. Yet the present 
model also seems compatible with MacK 


ay’s theory; in fact it has close simi- 
larities, as one can judge from MacKay’s summary of his theory: “ If perception 
is the adaptive ‘ keeping up to date’ of an organism’s state of organization fOr 
activity, then what requires informational justification is not the maintenance ° 
stability, but the perception of change,” Maybe the two theories differ mainly 
in their frames of reference. While the theories of the Stability of the Visual 
World provide a way of attacking the problem of the creation of the standarc 
to deal with it here it would be necessary to consider a whole set of experiment? 
which are only vaguely related to the perceptual moment theory. So that 
apart from this hint of a met 


B hod, this part of the model will be left almost 4° 
undeveloped as at the beginning of this paragraph, 


(ii) The effect of quick large chang 
model the accumulator has to dischar: 


Essentially, this is a very similar 
ty of the Visual World, since the 
y (1958) calls the signals from the 
spond to the signals from the image/ 
cancellation theory, an extension © 


= s nt 
es in intensity In the perceptual n 
8 at specific times. Hence there mus 
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some mechanism which acts as the * neural clock’ and triggers off the discharge 
of the accumulator. In the present model it will not have to behave like an 
ordinary clock, as the speed at which it runs will vary with stimulus intensity. 
A speculation about this mechanism will now be put forward, the main 
justification for which is that it is very simple and yet agrees with much of the 
evidence. The proposed mechanism consists solely of an accumulator. The 
accumulators that have been discussed before have all been fed by only a small 
number of receptors, maybe only one, and will be called specific accumulators. 
í Consider a general accumulator, which receives input from all sense recep- 
tors, and assume that as soon as its contents reach a fixed level it will discharge 
and the discharge can act as a timing signal which will trigger the discharges of 


SENSE ORGANS 


RETICULAR 
ACCUMULATOR 


SPECIFIC 
ACCUMULATORS 


STANDARD 
DETECTOR 


DECISION 
MECHANISM 


FiGunE 5. Elaboration of the Perceptual Moment Model. ‘The Decision Mechanism 


represents higher processes not dealt with in this paper. Its output to the Reticular 
Accumulator is to allow for the partial cortical control of arousal which is known to 
i exist. The outputs of the Reticular Accumulator are the timing pulses which 


trigger the discharge of the Specific Accumulators and the Standard. 


132 T. Shallice 


the specific accumulators. After the discharge it will start coer i 
again and the cycle will repeat indefinitely. Thus, we have a very St p 
mechanism which produces a discharge at regular intervals under steady 
stimulus conditions, but if the stimulus intensity is increased the rate of dis- 
charging increases. This increase would not be as great as the increase in the 
rate of firing of the nerve fibres upon which the stimulus acts, since the vast 
majority of the input channels into the general accumulator will be unchanged. 
The general accumulator will be known as the reticular accumulator, since the 
obvious place for such a mechanism is in the reticular system where impulses 
from all sensory pathways converge (see Figure 5). 

This suggestion is supported by Lindsley’s (1958) finding that the two-flash 
threshold is reduced by stimulation of the reticular system. Since the E.E.G. 18 
thought to be controlled by the reticular system, the speculation is also supported 
by the known correlation between the period of the r.r.c. and the perception 
of change (see Murphree, 1954; Surwillo, 1963). This was originally predicted 
from a theory, obviously related to the present one, that the alpha rhythm was 
acting as a scanner of the visual input (see Walter, 1950; Wiener, 1948), but the 
movement illusions that one would predict from the theory are not found (see 
MacKay, 1953). 

If the reticular discharges and the E.E.c. phase are related then the corre- 
lation between reaction time and alpha rhythm phase seems much smaller than 
would be predicted. This was known to be a difficulty for the visual scanning 
theory as well. The point at issue is that if a signal arrives just as the moment is 
about to close, it should be delayed in the accumulators for a much shorter 
time than a signal arriving at the beginning of the moment, In fact, a differ- 
ence of only about 6 msec between the effects of stimulation at the most and 
least favoured phases was found by Lansing (1957) and Callaway (1962), and 
Walsh (1952) found no correlation with phase at all. 

However, if the light is relatively weak, the consequent R.T. is usually 
long and the signal would probably not be detected in the first moment. Thus 
which phase will be the favoured one will be unclear, since the answer depends 
upon the chance of a signal being detected in the moment in which the signal 
arrived, relative to that obtaining when it is present for the whole moment. 
Consequently the resulting variability in R.T, will ensure that the effect of 
phase is much less than previously expected. When the light is strong, then 
whether the stimulus is detected in the moment in which it arrives is still a 

relevant although less important issue, but there is a further complicating factor- 
If the stimulus arrives early in the moment, then the moment will close earlier 
than had been anticipated, since the reticular accumulator will fill more quickly 
than before and the timing signal for the closing of the moment will arrive 
earlier at the specific accumulators. Therefore the difference in R.T. between 
the most and least favoured phases for detection will be reduced for inb reasons. 

Since strong stimuli, especially visual, affect the rate at which the reticular 
accumulator fills, bright flickering lights will produce a series of moments 
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varying in length. This will contribute to the Bartley Brightness Enhancement 
Effect, since, at certain speeds, the flashes will tend to fall into the longer moments, 
so that the contrast between the output of the accumulator in these moments 
and those preceding and following will be greater than if all the moments 
had the same length. In addition, since the moments vary in length and the 

standards’ with which current stimulation is compared are produced on the 
assumption of a constant situation, movement effects will be perceived. They 
will arise because the effects of eye movements are not correctly cancelled, 
as the period over which spatial averaging takes place is different from the one 
which provided the basis of the standard. This is a possible explanation for 
the well-known movement illusions produced by bright flickering light. 

This hypothetical mechanism will have to stand up to much more severe 
tests before it is more than a speculation, but it does show one Way in which a 
variable moment length could be made an intrinsic part of the model. Two areas 
in which it might be tested are those of flicker phenomena and visual masking. 
One difficulty with both these areas is their complexity, an 
is concerned there is the added difficulty that some of the experiments will 
ith recognition as well as the detection 


require an explanation which deals w 
gher level mechanisms, not 


of change. Recognition must be mediated by hi 
subsumed in the present variety of hypothesis. 


VI. APPENDIX 


To show that N — TJ /(1 — eT) is not a good approximation to the empirical 
(N, T) curve consider: 
h(T)= aes 
_ 21J 1—e7 
=e% TJ 
2 
"pe 


Now if WT)=1+2 where v41, 


then ire" =1 +v. 


eT =2[1-v+ O(2)|- 1 
=1 —2», to the first order in v. 
e-%T —1 — 4v, to the first order in v. 


h(2T)= —1 4-22, to the first order in 9. 


2 
Dre 
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Put T=50 msec, then 27— 100 msec, and the Bunsen-Roscoe Law pcs 
for absolute thresholds and small areas, at least to a high degree of approximation, 
so that N(2T) 2 N(T) (1--v), where v is very small. 


If the G.M.A. is a satisfactory model we should have 
N (200 msec) = N (100 msec) (1-- z), where z — 2. 


However, for high values of Q, z=1 (Graham and Kemp, 1938), and for low 
values of Q, 20:5 (Bouman and van der Velden, 1947), so that in both cases 
zz 2w. 
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FITTING A LINEAR TRACE DECAY MODEL TO TASTE 
COMPARISONS AND PREFERENCES? 


By R. A. M. GREGSON 


University of Canterbury, New Zealand 


Taste assessment procedures are examples of human sensory and hedonic 
judgements which have not generally been analysed in dynamic psychophysical 
terms, though an extensive statistical literature has grown up to cover the use of 
such procedures. A taste comparison procedure, using mixtures of wines as 
stimuli and 168 non-expert subjects as tasters, yielded data on five response 
measures which have been analysed using a linear trace decay model. The fit of 
the model is good and accounts for most of the observed variation in assessed 
differences which is associated with orders oftasting samples. Reasons for a poor 
fit in a minority of cases are discussed. 


I. INTRODUCTION 


This paper describes an examination of data from a taste assessment 
procedure, using a linear trace decay model to account for the detailed pattern 
of results obtained. Whilst the linear trace decay idea is familiar to most 
experimental psychologists, if only because it underlies some explanations of 
short term memory or of the negative time error or time-order effect, taste 
assessment procedures are not generally known to psychologists and some 
general comment on their form and use, and their attendant psychophysical 
problems, is therefore pertinent. 

The food industry has developed a number of procedures for describing 
or evaluating tastes and other properties of food, which are essentially examples 
of applied psychophysics. Such procedures have in general been developed by 
trial and error, more recently by statisticians consulting to the food industry 
[8, 10, 12, 35], and usually without much overt regard to psychophysical theory 
or precedents, although the psychometric problems are logically similar as 
Thurstone showed [31]. They are called ‘ assessment’ procedures because 
the comparisons involved are usually between a standard which is acceptable 
on both economic and psychological grounds and a slight modification of the 
standard whose taste acceptability is to be tested against the standard. 

The procedures used by food tasters involve rating, matching, identifying 
or discriminating between tastes, using—as appropriate—single or multiple 
taste stimuli, and verbal or numerical classifying, rating or scoring systems. 
Collateral chemical information on the stimuli is often available, and as might be 
expected the stimulus error is often committed [32]. Parallels to food assess- 
ment procedures can readily be identified in the literature of attitude scale 

1I would like to express gratitude to Mr. P. M. Shaw for critically reviewing early drafts of 


this paper, and to the Directors of J. Lyons and Company Limited, London, in whose tasting 
laboratories the experiment reported was done. 
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construction, multidimensional scaling, attribute classification or re 
psychophysics. Statistical models advanced to serve as quantifying eps gm 
for food assessment methods often have an oddly static quality [18, 17, 7] a 
though time errors, adaptation level effects, and serial interference phenomena 
never existed or could be ignored. . 
The literature of taste methodology frequently advocates procedures which 
are identifying or matching tasks: they stem in the main from Helm and Trolle s 
work [21, 35] on the triangle test, or from what is called the duo-trio test. 
Respectively these are: M 
The triangle test. Present the subject with three samples X.X Y (position of Y 
suitably randomized over successive trials) and ask him to pick out the odd one. 
It is assumed that the probability of doing this by chance is 1/3, irrespective 
of the serial order of tasting, whether the samples vary on one or many subjective 
dimensions, and whatever the subject's prior expectations are. 


The duo-trio test. Present the subject with X and Y, and then, after he has 


tasted them, present a third sample (X or Y) and ask for this to be matched to 
one of the first two. It is assumed that the probability of doing this by chance 
is 1/2, with the same assumptions as for the triangle test. The statistical power 
of various tests has been calculated on these assumptions [18] and a number 
of attempts have been made [2, 3, 12, 13] to take account of individual differences 
by complicating the statistics in various ways. All such models assume à 
constant single probability, for a given subject, of correctly performing the 
task. In attempts to increase the power of such procedures, the choice of say, 
the odd two samples out of five or the odd three out of eight has been advocated. 
One can only boggle at the psychophysical naivety of such suggestions in which 
the human observer is so readily treated as a static bioassay. 

Consider a case where we had, say, a mixed population of judges, some of 
whom were known to be completely blind and others completely sighted, and to 
whom we presented three picture postcards identical in size and texture cues 
but two bearing the same reproduction of a Rembrandt and the third a reproduc- 
tion of a Vermeer. Granted the independence of discriminatory and hedonic 
judgements, the plausibility of the statistical assumptions underlying the triangle 
or duo-trio procedures can be seen; they are in fact advocated precisely because 
their attendant statistical analysis is supposedly simple and legitimate; in short, 
a single parameter binomial probability model. This type of assumption ina 
slightly more sophisticated form, underlies the method of complete triads where 
we present stimuli X and Y, then Z, and ask the subject to judge whether Zis 
more similar to X or Y. This method is used in multi-dimensional scaling [33]; 
and is very similar to the 1-s-r (triad-similarity-rating) procedure used here. 

Empirical studies conducted to see precisely what happens in a taste 
assessment procedure—its “internal psychophysics’, if we may be permitted 
the term—do exist, but are few [22, 28]. Attempts to see if the internal psycho" 
physics are such as to cast doubt on the validity of the choice of statistica 
axioms used for significance testing are probably even fewer [16, 17]. Discussion 
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of the measurement problems involved, and the methods used [5, 6, 20, 27] exist. 

but we feel there is point in trying to fit a dynamic rather than static model 

to taste comparison and preference data, for three reasons: 

(i) To see whether a statistical or formal analysis of such data can usefully 
be made on results not specially gathered for the purpose of such analysis, 
because our analytical procedures are more satisfactory if they can be used 
in this way rather than being restricted to * contrived ’ situations. In this 
sense we want to perform what some statisticians would call a retrieval 
analysis. 

(ii) To see whether a model which relates the * internal psychophysics ° of a 
procedure to the general body of psychophysical results in taste and in 
other sensory modalities can be fitted to data, because there is value in 
demonstrating the generality of a theory in both fundamental and applied 
fields. 

(iii) To see what implications the analysis has for considerations of predictive 
validity, within the field of taste comparisons. 

For these reasons, there would seem to be some point in taking an existing 
taste assessment procedure and examining it as a judgement process without 
specially modifying it. We have, therefore, chosen a procedure from an 
unpublished comparative examination of procedures which varied in their form 
of instructions or in the order in which discrimination and preference judgements 
were elicited, which is not trivially simple, for which sufficient data exist, and 
which we feel illustrates some of the features and problems of statistical and 
psychophysical method in the context of taste measurement. 


II. EXPERIMENT 


Stimuli 
The original stimuli used were mixtures of two wines, a Graves (undated) and a 1957 
Barsac, both in bottle and in one batch from the same cellars. Three pairs of mixtures 
were actually tasted, as follows. In the 9/1 experiment: 
A=a mixture of 90 per cent Graves and 10 per cent Barsac 


B —a mixture of 10 per cent Graves and 90 per cent Barsac, 


in the 8/2 experiment 
A=a mixture of 80 per cent Graves and 20 per cent Barsac 
B —a mixture of 20 per cent Graves and 80 per cent Barsac, 


in the 7/3 experiment 
4 —a mixture of 70 per cent Graves and 30 per cent Barsac 
B —a mixture of 30 per cent Graves and 70 per cent Barsac. 
antly Barsac. Mixtures were employed rather 


than a straight comparison because it was desired to vary the difference in degree; the 
difference in the character of the two wines is lost provided the concentration of any taste- 
bearing substance in one wine does not fall below threshold in the more extreme (9/1 or 


8/2) mixtures. The mixtures reduce the sweetness difference to near-threshold, and the 


colour difference was lost under the viewing condition used (yellow light, wine in glasses 
more yellow, and had what professional 


Set on yellow paper), The Barsac was sweeter, 


In each case the B mixture is predomin 
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tasters call more ‘ body’: overall it is taken to be the stronger stimulus, in the sense that 
B then A is a more difficult pair to discriminate than A then B, provided time errors are 
negative. Fresh bottles were opened for each day’s tasting, the mixtures tasted in pas 
Mes of about 20-30 c.c. portions, the mixing being done at the time of decanting. 


Subjects 


In all 168 subjects participated, 48 for the 9/1 mixtures, 72 for the 8/2, and 48 for the 
7/3. The subjects were factory and office staff of both sexes and a wide age range. 


Procedure 


The subject is presented with three samples, of which two are identical and the pie 
is different. We will call the two taste substances A and B, so that in a set of three—| ene 
called a triad—we have, reading from the subject's left to right, the following spatial orders; 

Order I : Ay 4,B i 
Order]ll : AB, By 
Order III : B, B, A 
OtderIV : B 4, A, 


where either A, and A, or B, and B, are identical. Consider the presentation order I: 
we present A, A, B with Ag as the middle and last tasted stimulus, the order of tasting 
being: left, right, middle. The subject expresses a preference between A, and Ay by 
identifying the preferred stimulus and rating his preference on a five point scale; this 18 
called the ‘identical paired comparison’. He then does the same for A, and B; this 
is called the ‘ different paired comparison’. Then A, and Ay are spatially interchanged, 
the whole new triad A, A, B is retasted in the order left, right, middle, and the middle 
stimulus is rated on a five point scale for its relative similarity to A, and B. All the 
presentation orders I, IT, III and IV occur equally often in a total experiment. In the 
experiment here reported, each subject did three trials in succession, the design being such 
that any one subject did three of the possible four orders, and each order occurred equally 
often as 1st, 2nd or 3rd triad encountered. 


Each subject tasted the wines in isolation from other subjects, in tasting cubicles, only 
the experimenter being present. 


The wines were served at room temperature (warmer 
than is usual for table wines of these types) and palate cleansers 


usua p in the form of rye crisp- 
bread biscuits were eaten before each triad of samples, but not between samples, 


Instructions 


The subjects were told that the experiment was concer 
wines, and the use and importance of the palate cleansers e 
told: 


“Here are three samples o. sets the glasses out spaced evenly), 
would you please taste first the right-hand sample, then the left-hand sample, and finally 
the middle sample. 'l'ake small sips. Would you now say how much you prefer or 
S ied a ps or the right-hand one, using this card ”, (A card was presented 
o y earing the statements: “ Pr i 7 »c i e 
strongly." “Prefer this one," « Mesa Ted aoa poca T 
either". These five statements 
treatment of results, although no numerical values were ever shown 
. This procedure was repeated with the middle and left-hand glasses. The two actually 
identical mixtures were then inte » and the subject asked : ` 
- demi tor right, then the left and finally the middle one, and say 


E this card.” (Card presented 


ned with tasting white table 
mphasized, They were then 


f wine (experimenter 
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bearing the statements: “ Same as the left-hand one." ‘‘ More like the left-hand one.” 
“ Equally different from both right and left." —'* More like the right-hand one.” '' Same 
as the right-hand one”). This procedure we have called t-s-r (triad-similarity-rating) and 
Likert values 1 to 5 are given to the five statements but in such a manner that the correct 
statement is always scored 5 irrespective of its laterality. 


III. THEORY 


A linear trace decay model [7, 23] will be used to make predictions about 
the effects of each of the four presentation orders I, II, IIT, IV. 

To construct any theory to account for the pattern of perceived and valued 
taste intensities in our experiment, we need a notation, and some assumptions 
which we make implicit or embodied in the notation. In the model we treat all 
subjects as replicates of each other, and assume they all behave in the same way 
as regards their self-paced tastings. Let W (standing for A or B) be the 
effective intensity of a stimulus at a point in time. We consider the three 
stimuli in a triad to be tasted at points in time which we will call ^j, 7; and ta 
successively. Now for a linear trace decay the value of W falls with time. 
With the assumption that 7; — tọ =t,—t, — (a constant interval), W will decrease 
over the interval by a multiple of W, say ôW, where 12 820. 

In practice the intervals between tastings are uncontrollable to very precise 
limits, but timing a sample of tastings showed the interstimulus interval to be 
very regular and modal at about six seconds: the actual time intervals are all 
longer than the short interval in which positive time errors have been reported 
[26]. Changes in the direction of negative time errors have more usually been 
reported in other sensory modalities. 

Let A, B also be used to refer to the two stimulus intensity levels in a given 
triad, and further assume B=(1 + 7)4, where 12 770. The linear trace decay 
of an A stimulus will then be 5A, but of a B stimulus will be òB = ôA + óz4. 
The term 3z4 is assumed to be second-order and will therefore be neglected. 

We distinguish between the effective stimulus intensities—if we like to 
speculate these could be what have been called the ' proximal stimuli’ or neural 
correlates of peripheral stimulation—and the subject’s response, because the 
subject expresses the effective stimulus intensity, or some comparison between 
such intensities, by a response choice which is converted in turn to a probability 
or a rating on a scale. . 

'The actual response measure we use presupposes some psychophysical 
transformation y within the subject, hence we may write (WV) for the subjective 
estimation of a stimulus magnitude, and Z(J(W)) for a hedonic evaluation: 
here the notation is intended to imply that (W) is a necessary prior step to 
h{js(W)}. We will assume, so as to simplify the argument, that /( W) is linear on 
W, h (/(W) ) is linear on (TW), and recorded measures y' or h’ of } or h responses 
respectively are linear on J(W) or h(J(W)) over the stimulus magnitude range 
considered. 
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In this sense # and h are intervening variables, J^ and k are Ferm 
-indicators [15] of these variables, and the subsequent argument 1s to = ta x 
as interpretable in y^, k or y, h measures. For convenience, there n v i 
will write (IW) and h(W) as an abbreviated. notation for y (W) or ( ) "i 
h' Y(W)} respectively throughout; the meaning in functional notation shou 
be clear from the context. 

Considering presentation order I, we have 


A, at tg, therefore A—25A at ta; 
B at ty, therefore A+ 7A — ôA at tz; 
A, at to, therefore A at ty; 
for t, —ty=tp—ty. 
The identical paired comparison is A, with A, or (4—284) with A at tp. The 
different paired comparison is B with A, 
or (1+7—5)A with A at tp, 
or [14-7 — (k-- 1)8]A with (1—R8)A at tj, 2, 
allowing for delay between tasting and evaluation, where k is any multiplier to 
stretch the time interval for which 84 is the amount of trace decay in unit 
time. The t-s-r judgement is 
4—284 with A at ty; 
A+7A—8A with A at fy. 
Hence the judgements elicited are: 


For the identical pair, h(28A); 


(1) 
for the different pair, h[(7 — 8)4]; (2) 
for the t-s-r, J[(7 — 8)4]» (284). (3) 


Given the linearity of (W) on W, 


a> 38 for correct matching. 

If only the largest difference controls the response, i.e., if | 7 — |> |28| with 
7 then for the t-s-r the judgement elicited is 

[7 3)4], 


and the recorded measures are linear functions of (1), (2) and (4). 


(4) 


Therefore, for each of the four presentation orders we have responses 
with the theoretical relative magnitudes given in Table I. 


'TABLE I. ‘THEORETICAL RESPONSE MAGNITUDES FOR EACH TASTING ORDER AND RESPONSE 
MEASURE, 
Tasting order Identical pair Different pair t-s-r 
I (ABA) h(284) h[(—8)4] l(a — 8)A 
II (ABB) (84) h((7-28)4] J[(m4268) dh 
III (BAB) h(284) h [(7 + 8)4] Yil + 8)A] 
IV (BAA) h(SA) 


h[(7—28)4] | J[(m-28)4] 
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Response measures 

For any given response measure employed over all the 12 terms of theabove 
table, for the three stimulus mixtures 9/1, 8/2 and 7/3, we can obtain estimates 
of their relative magnitudes; with the restriction that we cannot, by 
definition, use the same metric for h and 4. 

From the choice or rating response which each subject made during the 
experiment, as described above, we have derived five response measures; four 
of them are hedonic and symbolized as h, to /y, the fifth based on the t-s-r 
ratings is a measure of similarity symbolized as Js. It is stressed that 
there is an implicit V function in all five measures; hence the enumera- 
tion of suffixes. For the rating scale measures Žo, h4 and y5 the zero or scale 
unit is in part arbitrary; we have chosen numbers to give comparable magni- 
tudes throughout, but similarities between the obtained (4 and 3) estimates for 
different response measures should be regarded with reserve. 

Identical pair proportionate preference, hı: in each triad tasted, the ' identical 
pair’ preference (between A, and A, or between B, and B,) was recorded as 
a straight choice, with ‘equals’ judgements allowed and scored (3, i) for 
conversion to proportions; straight preferences scored (1, 0) or (0, 1). All the 
preferences for triads of one order were pooled, and the proportions of all 
such triads in which the second stimulus (A, or B5) was preferred was obtained. 
Each triad order is different in trace decay terms (though not in physical terms) 
and must therefore be considered separately. The pooled proportionate 
preferences for each triad order under each mixture condition are converted to 
unit normal deviates by treating each proportionate preference as an area under 
the cumulative normal curve [33]. 

Identical pair pooled ratings preference, họ: corresponding to h, above, but 
in rating form instead of choice form, the strength of preference was recorded 
for each identical comparison (1 < preference strength <5), the pooled frequency 
distribution of such ratings over all conditions was obtained, and its mean and 
s.d. used to express the mean rating for each of the 12 triad-order and stimulus 
mixture conditions in standardized deviate form. Negative values here do 
not, then, indicate reversal of preference but indicate less than average preference 
strength, with direction unspecified. 

Different pair proportionate preference; hg: this measure is obtained in exactly 
the same manner as /, but is based on pooled proportionate preferences for the 
different pairs (between A and B) in each triad; transformed in the same way 
and using the same scoring conventions. 
Different pair pooled ratings preference; hy: as for hs 
of preferences for one or other member of the different pair, but here we have 
taken account of the direction of preference and not merely the strength, and 
Combined two 5 point scales back-to-back to make one 9 point bipolar scale. 
This can be done because rating * 1' =‘ indifference ' on each 5 point scale (one 
Scale for each direction of preference, A preferred to B or B preferred to A) 
becomes the mid-category of the 9 point scale running from ‘ strong preference 


we have ratings of the degree 
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for A’ to ‘strong preference for B? (1 <preference <9). These combined 
ratings were pooled to obtain the s.d. of the rating total frequency distribui ony 
but in this case the standardized values are expressed about the mid-point o 
the frequency distribution, not about their pooled frequency distribution mean. 
This implies that each standardized value has a constant added to it, but aes 
an obvious meaning in terms of preferences to the sign of each standardize 
deviate value. The scales combined back to back each yielded a centrally tending 
frequency distribution skewed towards ‘ indifference’, but the frequency © 
‘ indifference’ responses was sufficiently large for the combined /i, scale to be 
centrally uni-modal. 

Correctness of matching as a similarity rating response, s: For each triad order 
the t-s-r rating (1< similarity <5) was recorded, with half the ratings corrected 
for laterality so that ‘ 1 ' =‘ same as the left-hand one’ is now replaced by  1'— 
‘perfectly correct match’. (The left-hand stimulus is the same as the 
middle one in half the triads and the same as the right-hand one in the other half.) 
The s.d. of the pooled frequency distribution of these corrected ratings was used 
to standardize the 12 mean ratings, for each triad order and stimulus mixture 
condition, about the mid-point of the similarity rating scale; so that a positive 


value indicates correct matching. As for h4 each standardized value (distributed 
as (0, 1) ) has a constant added to it for clarity of meaning. 


IV. RESULTS 

We set out the results in tables, for each of the response measures in turn; 
the obtained values are given first and the predicted corresponding value in 
brackets immediately afterwards. 

The predicted values are obtained from the relation between the theoretical 
values in Table I. The linearity assumptions we have made together with the 
assumption (0) —0, or (0) &(min: 7, 8) permit us to add the four values of 
h,(W) in the second column of Table I headed * identical pair’ [or /(W) analo- 
gously] to give a sum equal to h,(28A + 84--284 + 84) = A,(684) =6h,(8A), so 
1Zh,(W) is our estimate 5 of h,(8A), and the predicted values are then propor- 
tional to 28, $, 28 and 8 reading downwards. 

In the case of hg and /;, the predicted values are obtained from the relations 
between the theoretical values in the third column of "Table I, again using 
our linearity assumptions to combine the four terms, their average being an 
estimate of ha( 7A) [or I (7.4) analogously], for Ii(z — 84+ 7+28+ 7+ 8+ 7-29) 
=h,(4z), so Eh (W) =, whilst hy[(7+28)A] - o + 8)4] — hir- 84]- 
hy[(m —28)4] — (684) = 68 as for h, or hy. We substitute + and 9 values to 


give the expected values shown in brackets. In the case of jj; we solve as for 
hg or hy but with y instead of h. 


For any measure we thus obtain theoretical values proportional to the corres” 
ponding terms in Table I, and with the same mean value for a block 25 ! e 


observed value. The number of observations i VIS 36 
) per cell in the Tables I- 
for the 9/1 and 7/3 mixtures, and 54 for the 8/2 mixtures m ths metho a 
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fitting theoretical values is based on pooled data over all subjects and leaves 
one degree of freedom for each column of four entries, 

The statistical significance of the agreement between observed and theoreti- 
cal values is not readily assessed as the five measures are not homogeneous 


perfect fit and increases with Progressively worse theoretical predictions. 


The variance ‘ scales up ' the mean squared difference for comparisons between 
measures.1 


Tables II to VI are all arranged on the same plan, as follows: each of 
the three columns refers to a stimulus mixture condition, first the 90 per cent 
A+ 10 per cent B compared with 90 per cent B 4-10 per cent A, designated 9/1 as 
in the previous discussion, then the 8/2 mixtures (more similar and 


distortions in the scaling transformation procedures by which the response 
measures were obtained $ is not linear on 8. The rows of the tables refer to 
the four possible orders in which the triads were tasted, using the notation 
given previously. In each cell the obtained response measure is given, with its 
theoretical value in brackets after it. At the foot of each column is given the 
estimated value of ô, and where applicable that of z also, from which estimate (or 
estimates) the theoretical values immediately above were obtained, the mean 
Squared difference of observed and theoretical values (m.s.d.) and the ratio of 
m.s.d. to the variance of observed values (var. ratio). 


TABLE II. IDENTICAL PAIR PROPORTIONATE PREFERENCES, (/) 


Normalized observed and theoretical values (in brackets) for order preferences on 


identical paired comparisons: all positive values are preferences for the second stimulus 
in the pair tasted: 


Mixtures: 


Order 9/1 8/2 7/3 
i 018(028) 0-13 (0-13) 0-21 (0:25) 
II 0:28 (0-14) —0-21 (0:07) —0-08 (0-13) 
III 0-18 (0-28) 0-08 (0-13) 0-44 (0-25) 
Iv 0:18 (0-14) 0-39 (0:07) — 0-18 (0-13) 
h,(8) 0:137 0-065 0-125 
m.s.d. 0-0103 0-0183 0:0211 
var. ratio 5:42 0-403 0:679 


Bst above observed values should be regarded with reservation because of the large 
Ort; 


raw d lon of tied preferences [scored à, 3 in the generally accepted convention] in the 
ata, = 


sE ‘ef, Kruskal, J. B. (1964), Psychometrika, 29, 9, for a further comment on this. 
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“pape III. Ipenticat Pam Poolen RATINGS PREFERENCE (3) -— 
7 re 
Standardized observed and theoretical values (in brackets) for order Pre ie 
aled on identical paired comparisons, positive values indicate a mean pre 
sci 


ference strength 
greater than average: for the whole data pooled. 


Mixtures: 
Order 9n 8/2 7/3 
I —0-15 (024) —0-13 (— 0:16) — 0:11 (0:04) 
II +0°34 (0-12) —0:19 (— 0:08) +0-11 (0:02) 
IH 40:63 (0:24) +0-15 (—0-16) +0-13 (0:04) 
IV —041 (0-12) —0-35 (—0-08) —0-02 (0-02) 
ha(8) 0-12 —0-08 0:02 
m.s.d. 0:0654 0:0455 0:0101 
var. ratio 0:622 1:39 1:04 


The h, values are also to be taken with reservatio 


a response statement. 


Taste IV. DIFFERENT PAIR PROPORTIONATE PREFERENCE, (Its) 


Normalized observed and theoretical preferences for A or B in different P' 


howed 
n as the original raw data s} 
marked response preferences for some statements on the card fr 


om which subjects 


chose 


aired 
comparisons, all positive values are preferences for B. 
Mixtures: 
Order 9/1 8/2 7/3 
I 0-67 (0:57) — 0:24 (0-32) -0:03 (0:06) 
il 0-81 (0-84) ^ 0-65 (0-68) 0-28 (0:54) 
IH 0-79 (0:75) — 0:59 (0-56) 0-63 (0:38) 
IV 0:36 (0-48) — 0:24 (0-20) 0-00 (0-10) 
fim) 0:66 0:43 0:22 
ha(d) 0:09 032 0-16 
m.s.d / 0:0067 0:0025 0:0353 
var. ratio 0:207 0:67 0:499 


TABLE V. DirreRENT Pair PooLeDn RATINGS PREFERENCE (h4) 


Standardized observed and theoretical preference: i 
i s fi d on 
paired comparisons, all posi or A or B as scale 


about the mid-point. 


dise: 
itive values are preferences for B, the scale being stan ardi 


Mixt: : 
Order 91 8 7/5 
I 0:67 (0:59) 0:22 (0-26 "l D 
IL 0:65 (0-74) 0-45 nal wd ean 
Il 0:79 (0-69) 0-47 (0-42) 0-41 (0-35) 
IV 0-44 (0:54) — 023(018) 0-00 0-01) 
haz) 0:64 0-34 0-23 
hid) 005 0-08 012 
md. 00086 0-0023 0-0019 
var. ratio — 0-541 0-163 


0:055 


"m 
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TABLE VI. Correctness OF MATCHING as a SIMILARITY RATING RESPONSE (hs) 


Standardized observed and theoretical t-s-r matching scores, all positive values 
indicate mean matchings are on the correct side of the scale mid-point. 


Mixtures: 
Order 9/1 8/2 7/3 
I 0-71 (0-67) 0:54 (0-61) 0-11 (0-09) 
II 0-92 (0-82) 0-81 (0-82) 0:50 (0-48) 
II 0-67 (0-77) 0:76 (0-75) 0-33 (0-35) 
IV 0-50 (0-62) 0-61 (0-54) — —0-06 (-0-04) 
sm) 0-72 0-68 0-22 
(8) 0-05 0-07 0-13 
m.s.d. 0-0092 0-0025 0-0004 
var. ratio 0-411 0-210 0-009 


The correlations between corresponding values in the above tables for hg 
and y, have been calculated; for the observed values r= +-80, and for the 
theoretical values r= +-98. One would expect, over the range of differences 
encountered here, that A(is)=ays+b where a and b are constants, though some 
loss of agreement would arise because subjects are not unanimous in their 
preferences; in other words 7 may be positively or negatively monotonic on y% 
and in any sample of tasters we are faced with the problem of expressing a 
population of relations of the above form in one equation. The dominant 
preference for B mixtures here enables us to do this, but there is necessarily some 
loss of information incurred if we do it. 


V. Discussion 


The above results in Tables II-VI indicate that the linear trace theory 
accounts reasonably well for differences between the four presentation orders 
used. The best correspondence of theory with experimental findings occurs 
on the responses to stimulus comparisons between physically different stimuli 
(Tables IV, V and VI), but not apparently between the most different stimuli, 
the 9/1 and 1/9 Barsac-Graves mixtures. Two aspects of the results deserve 
comment: the almost complete failure to fit the differences between presentation 
orders for the identical paired comparisons (Tables II and II), and the very 
close fit to the 8/2 and 7/3 mixtures columns in Tables IV, V and VI. . 

The human judge is in no position, on available introspective evidence, 
Phenomenologically to decompose a sensation difference into trace decay (8) 
and real difference (z) components; the perceived differences which yield the 
A, and hy preferences of Tables II and III are to him merely very small differences, 
Nearer to zero than most, but not all, of the other differences encountered in 
the test situation. For such small differences we suggest that responses are 
Senerated by a decision process which is comparatively inefficient in the sense 
that it yields too many false positive or negative responses: in the language of 
Signal detection theory which may be more pertinent here than classical psycho- 
Physical threshold models [9] we are working at stimulus differences which are 
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so slightly above the background variable level of irrelevant taste sensations that 
the subject’s likelihood ratio criterion for reporting any difference is only met 
part of the time. Our linear trace decay model is in fact a more elaborate form 
of a classical difference detection theory and cannot by its nature cope with the 
form of guessing strategy used by subjects responding to what are traditionally 
considered to be near-liminal or subliminal stimuli. Anomalous results are 
often reported in this region [25] and we hope soon to publish new data on 
this problem. 

The slightly worse fit of the theory to the more extreme differences 1n the 


9/1 columns of Tables IV, V and VI we consider arises in the following manner. 


It was noted previously that the two wines differed in other qualities than sweet- 
ness. 'The more extreme mixtures wi 


ll therefore tend to show differences in 
other qualities than sweetness because weak taste or odour characteristics of 


one wine could be just detectable in 9 parts in 10 but just not detectable in 1 
part in 10, whereas changing to 8/2 and 2/8 mixtures could make the same minor 
characteristic apparent in both mixtures. In this way, the 9/1 comparisons 
need not be made on the same basis by all subjects (neither for preference nor 
similarity judgements) whilst the 8/2 and 7/2 mixtures would tend to be judged 
on sweetness alone, as predominant characteristic, and hence comparisons 
would be on a basis more nearly consistent with the theory. The possibility 
of multi-criterion discriminations for taste is well known to workers in this 
field [36] and can be investigated by appropriate multidimensional scaling 
methods. 

Previous work [14] suggests that a linear trace decay model should be 
appropriate for describing gustatory judgements and affective judgements [4]. 
Our findings are thus compatible with these earlier studies, but our paradigm is 
more complex and drawn from an applied rather than a fundamental context. 

The poor fit of the model for h, and hẹ measures raises the questions (i) 
how could the model be modified to accommodate the deviant observations, 
short of replacing it with a signal detection theory which rests on different 
assumptions, and (ii) what implications has the pertinence of the model when 
we come to ‘select statistical tests to investigate the non-randomness or psycho- 
physical causality of taste discrimination and preference behaviour; does it 
cast doubt on the legitimacy of any currently advocated statistical procedures? 

The following suggestions are offered as heuristic. (i) The deviant observa- 
tions of h and /i4 must be a consequence of trace decay and other response 
processes superimposed, such as guessing strategies, response sets to the rating 
scales, and so on. As we are comparing four such identical paired comparisons 
it would seem reasonable to assume, if we do not wish to discount the between 
presentation orders variability as random error, that the differences are due t? 


differences in the rate of trace decay, all other sources of response variability 


being comparable in their effect over the four presentation orders. Lauenstein 


[24] suggested that the rate of trace decay is a function of the difference betwee? 


the stimulus intensities encountered and the background level of sensory 


& 


A 
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excitation, a suggestion which anticipates later adaptation-level theory. Revisin 


our assumptions of the theory to incorporate Lauenstein's idea, we make §B = A8A 
where À is some multiplier such that 1 SAU (an arbitrary upper bound). 


TABLE VII, Comparison or Trace Decay TERMS FOR IDENTICAL PAIRED COMPARISONS 
IN ORIGINAL AND MopirriED THEORY 


Tasting Original model Modified model 
order from Table I 


I (28.4) ALZS(2+2)4] 
II A(84) A[38(1 4-234] 
; HI (284) A[38(1 4-224] 
IV A(84) A[38Q 34] 


the original model for h, and hy are those pertaining to order III Where the 
obtained values are much larger than the theoretical, This discrepancy might 
be accommodated by making À large, but it may equally well be the case that a 
non-linear trace decay model, or one in which serial interference between 
judgements is allowed for, could accommodate the data. In view of the 


or triangle tests (with the important possible exceptions of [29, 34]) because we 
have a judgement Process which is not determined by one response parameter, 
4 probability of detecting a difference, which for a given procedure is greater 


map onto z alone, but onto ~ and 8, and if h'[y(z, 8)] is not linear on j(z, 8) 
then some quite marked, reliable and Yet artefactual preferences could be 


VI. GENERALIZATION 
It is frequently recommended that subjects chosen for food assessment 
tasting Panels should be screened on their absolute taste thresholds for the four 
h imary tastes; Sweet, acid, bitter and salt, before these subjects are employed 
o tasting experiments [6]. This screening is intended to eliminate insensitive 
"typical Subjects. "This does not meet all the implications of our trace decay 
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model, for we have introduced a second parameter 8, and whilst it is plausible 
to assume that 7 may be a function of individual difference thresholds, we 
should make no such a priori assumptions about ô. ; 
As an indication of what is implied in sampling a population of tasters in 
the light of the 7,8 model, we first assume that log 7 and log ô are distributed 


as a bivariate distribution [1], then log (7/8) will be distributed normally with 
parameters pra and ors 


For a population of judges for whom A and j are in 1<+1 correspondence, à 
representative sample from that population for tasting purposes is one for which 
E(log 7), E(log 8) and E{log (7/8) )*] are matched respectively with pm P» an 
(not 035;) Where pay pa are parameters of the parent bivariate population. 


We suggest it is in this above sense that a panel of tasters should be shown 
to be representative for a given gustatory prediction. 


VII. CONCLUSIONS 


Detailed examination of the judgements in a taste assessment procedure 
asts doubts on the legitimacy of some statistical models currently used. A 
linear trace decay model of comparison judgements provides a more valid 
description and explanation of the results of the assessment procedure, but 
necessarily complicates the picture. We conclude that a psychophysical 
examination of taste assessments is to be preferred on grounds of validity to 
the arbitrary and static descriptions underlying ' biometric’ approaches, and 
that our statistics should attempt to accommodate the psychophysical evidence 


before any generality can be claimed for quoted results on the discriminability 
or relative acceptability of tastes. 
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HIGHER-ORDER FACTORS 
By C. J. Apcock 


University of Illinois 


The paper discusses the hierarchical conception of factorial structure 
developed by Burt and his research students, and examines the alternative 
approaches preferred by Thurstone and Cattell. It is argued that second-order 
factors cannot be distinguished from first-order factors by mathematical criteria. 
It follows that interpretational criteria are requisite and the method of trans- 
formation described by Schmid and Leiman is recommended. 


I. INTRODUCTION 


The hierarchical conception of factorial structure has two sources. The 
first and earliest derives from the centroid method of analysis—the method of 
'simple summation', as it was originally called—and is associated with the 
name of Cyril Burt (1940, 1950). He has argued that a hierarchical concept 
of human mind is plausible on neurological grounds, and that centroid factors 
provide a confirmatory scheme in so far as the first factor is usually positive 
throughout and all succeeding factors are bipolar, thus permitting repeated 
subdivision and capable of alternative representation by ‘ basic’ and ‘ group’ 
factors (cf. Moursy, 1952). To such a scheme there are familiar objections. 
In this case all the factors fall within an arbitrary reference frame determined 
by their initial representation in the sample of tests; the number of levels found 
depends upon the number of factors; and the scheme must in practice be com- 
pressed into a highly artificial model irrespective of actual causal factors, unless 
(as Burt insists) the tests are carefully chosen with some hypothesis in view. 
Otherwise the results from any given particular sample of variables can only 
be used to gain some preliminary insight into possible structure and can never 
Provide a fixed scheme which can be replicated. Burt (1954) has taken note of 
these criticisms, and meets them by maintaining that the function of the statistical 
analysis is primarily to confirm hypothetical causal structures tentatively 
Inferred on the basis of antecedent evidence. 

The second line of approach begins with a non-hierarchical or reticular 
Concept, derived by oblique rotation. Thurstone suggested criteria for getting 
3Way from the arbitrary reference frame of centroid analysis, and demonstrated 

3t such criteria could be meaningful provided the factors were oblique. 

* principle of rotation to oblique simple structure has been widely accepted. 

we teils, however, the recognition of second and even higher-order factors if 

ie: to account for all of the variance, and so in the end we get back to a 

archical model, but one which enables us to determine the number of levels 

ee criteria and the position of our reference frame at each level by simple 
ure and/or psychological criteria. 
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Cattell (1962) has argued against both hierarchical concepts. He regards 
higher-order factors as evidence of causes acting on the lower-order factors, 
but insists that this does not imply a hierarchy, although the factor model may 
seem to indicate it. The seeming hierarchy is only part of a wider system which 
takes the form of a network or reticule. Empirical findings often seem to 
accord with such a view. The present writer is inclined to think that, although 
the causal relations will always be complex, and often manifest themselves ina 
correlational network, yet we shall be able to distinguish hierarchical systems 
whose interconnections will explain the reticule. Such a hope can do no more 
than generate hypotheses, however. In the empirical case we can expect to 
find a reticule. Our interpretation of these relations may or may not suggest 
important hierarchies at work; but we cannot beg the question by assuming 
either that they must be there or that they cannot be there. 

In this paper I wish to put forward a strong plea for flexibility in interpreting 
factorial data. It is only too easy to set up a mathematical model, base a tech- 
nique upon such a model, and then, because we have obtained results in this 
way, assume that the data must be in accord with the model assumed. Obviously 
to allow the more or less arbitrary choice of method to determine the range of 


our hypotheses is to prejudge every situation. I shall illustrate this by reference 
to the concept of higher-order factors itself. 


IL HIGHER-ORDER FACTORS 

When is a Factor a Higher-Order Factor? The definition of a higher-order factor 
here adopted is simple enough. It is a factor whose variance extends over 
the range of several lower-order factors, but always in proportion to the weighted 
sum of the lower-order loadings. Normally we indicate this variance only in 
terms of the loadings of the higher order on the lower order; but since this variance 
is measured through the variables obtained in the first place it is also possible to 
roit kr is Mir - variables themselves as described, for example, by Schmid 

In Table I, I give data for a very simple case involving only two primaries 
and one second-order equivalent. In this case the we man eser has 
equal loadings on both primaries, and these are non-overlapping; so that all the 


Taste I, A GENERAL FACTOR WHICH IS EQUIVALENT TO A SECOND-ORDER FACTOR: 


A B c 
40 80 

30 60 

20 40 

30 

25 50 
2 40 


! [n this Journal the definition of a ‘higher-order factor’ is that of ‘Thurstone and Cattell- 
‘The type of factor here described is what Spearman and Holzinger originally termed a ' pifactor | 
Later this latter term was used as described bel y e termet 


ow, p : N xe enr 
‘bifid’, see this Journal, 3, p. 59 and refs, (dior Ww, and the proportional factors Wt! 


ial Note). 


Higher-Order Factors 155 


relations are obvious on inspection. No one of these second-order equivalent 
loadings may be changed without also making a corresponding change in the 


the other hand, it is quite feasible to have a general factor which does not have 
this relation to the group factors. Table II illustrates a parallel form in which 
the Proportionality required by the second-order factor is not met. 


Taste II. A GENERAL FACTOR WHICH IS NoT EQUIVALENT TO A SECOND-ORDER FACTOR 


A B C 
60 80 

50 60 

30 40 

50 60 
40 50 
30 40 


A factor pattern of this kind can be obtained either by Burt’s (1950) group- 
factor approach or by Holzinger’s bifactor method (Harman, 1960). Neither 
method has had widespread use, because they lack the flexibility of the oblique 
rotated centroid of principal axis solutions. Both aim at non-overlapping group 
factors, and both allow only one general factor. Only in specially selected cases 
is this likely to fit the data. In most cases we can expect overlapping group 
factors, wider factors spanning several group factors and even more than one 
general factor, I am not, therefore, advocating these methods as against the 
oblique rotation approach. All we are concerned with here is the relation 
between a general factor and the group factors which it spans. The difficulty 
of calculating such a group factor, except in very simple instances, is irrelevant. 
The factor pattern is theoretically possible; and, provided the data are suitable, 
can be calculated. What then does it mean? 

Clearly such a general factor differs from a second-order equivalent in 
that its variance is not mediated by the group factors or the primaries. 
Spearman proposed an interesting analogy for his general factor, although he 
himself was unaware of the distinction we are considering. His notion of a 
common source of energy operating through various motors involves just the 
mathematical relation required by the second-order model, Changes in power- 
Supply can affect Work-output only through the motors concerned, i.e., through 
the primaries, In contrast to this we might consider the case of income which 
'S determined partly by a man’s age and partly by the salary range obtaining in 
his Profession. If the former is assessed and received directly without relation 
to his employment, we have the effect of a general factor not geared to the group 


“ctors represented by the several professions. In theory it might be argued 
at Spearman should not on his own principles have entertained the power- 
ed analogy with regard to his general factor, nor can we validly adopt the 
*8¢-profession analogy for a second-order factor. Neither conception fits the 
podel; and all interpretation along lines such as these should, strictly speaking, 
Je excluded, 
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In practice, however, it would be exceedingly foolish to do so. UE 
data may give rise to either kind of factor. Admittedly the data of Ta > 
cannot be squeezed into the form of Table I; but, provided we are prepare = 
tolerate a little fuzziness (which in the empirical case will be present 1n ae 
solutions) these are genuine alternatives depending solely on the method ii 
analysis. The second-order case will generally involve at least one additiona 
factor; but none of these factors will necessarily prove fully significant. Harman s 
(1960) 24-variable example is resolved into a general factor and five group 
factors by the bifactor method. Only four of the group factors turn up 1n his 
oblique rotated centroid solution; but inspection of the latent roots of the 
principal factor solution shows that by Guttman’s criterion he should have 


taken out a further factor; and, had he done so, the rotated outcome would have 


been similar to the result obtained by the centroid factors based on the original 
bifactor solution, which does in fact yield corresponding group factors. ‘This 
example is an excellent illustration of the fact that the same data will give parallel 
results when handled by different methods; and the decision as to which the 
model is to be assumed (other than for convenience of calculation) is one that 
cannot be based on mathematical criteria as such. 

Since mathematical criteria do not appear to offer us any safe means of 
distinguishing between data which need to be interpreted in terms of a second- 
order model and data which call for a general factor model, we are thrown back 
on other criteria. The psychological meaning will be crucial. Any finding 
must be fitted into a wider psychological system, and all we can do is to accept 
the interpretation which best fits the wider framework. This means that we 
must always, irrespective of the computational method we have chosen, consider 
both possibilities. But it means also that we can usually choose our method on 
the basis of its computational advantages, and may therefore select the more 
flexible oblique rotation approach. By submitting such a solution to a Schmid- 


Leiman (1957) or Cattell-White (1963) transformation we may gain the advantage 


of seeing the higher-order variance as it relates directly to the variable: 


s as well 
as int 


he usual form. This enables us to give adequate consideration to the 
general-factor hypothesis; but it also has the merit, in the Schmid-Leiman case, 
of providing us with coefficients which will indicate the relative importance of 
the factor in regard to the variables concerned. As Cattell has emphasized, 
the usual oblique factor pattern does not provide true loadings in terms of which 
the correlations might be generated. With the Schmid-Leiman (1957) trans- 
formation we have all variance represented in a single level orthogonal system, 
the number of factors being the sum of those appearing at all levels and the 
orthogonality of the factors deriving from the fact that all correlation betwee? 
factors is now replaced by the variance of the higher-order equivalents. 

The drawback to such a procedure is that the lower-order factors at each 
stage are credited only with the unique variance they contribute directly, and 
their contribution via the higher order factors appears separately. Cattell 2% 
White (1963) wish to have their cake and eat it too; and consequently they 


TT S 


a 


d 
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adopt a compromise which retains the full variance of the higher-orders! at the 
expense of no longer having an orthogonal system permitting inter-level com- 
parisons. For some purposes this will certainly prove an advantage; and there 
is room for both methods of approach. But it is necessary first of all to make 
sure that one’s choice of method does not prejudge the issue of interpretation. 

In the light of this discussion it seems possible to adopt some simple rules of 
procedure. In view of the restrictions of the bifactor method it would seem 
desirable in most cases to begin with a principal factor solution, using estimated 
communalities in the diagonal and possibly iterating several times to improve the 
communalities, the number of factors being first decided by the Guttman 
criterion or by some estimate of sampling error. At this Stage we can carry out 
an oblique rotation, and proceed to higher-order analysis. Finally we carry 
out a Schmid-Leiman transformation. The last form becomes the basis of our 
interpretation, but should not bias our attitude. We must take account of the 
hypothesis suggested by the higher-order relation. There must be a 
constant reference to the original higher-order analysis and possibly also to a 
Cattell-White transformation, Such a procedure permits us to bring out all 
the significant relations without committing ourselves to any particular model 
for our interpretations, 


III. INTERPRETATION OF GENERAL AND HIGHER-ORDER Factors 
I shall now consider certain hypotheses which may be advanced to account 
for what appears as a higher-order factor in oblique analysis and which may 
derive from some kind of general factor. Let us begin with what is probably 
the most frequent case, that of a true higher-order factor as required by the 
mathematical model. 


A True Higher-Order Factor, The simplest case will be that of a single second- 
order factor, The level is of no significance since we can always measure a 
higher-order factor directly by making use of appropriate tests.? It may appear 
at different levels in different analyses. What we are concerned with here is 
the nature of the relation between the different levels. 

We may take as an instructive example the box analysis of Thurstone (1947) 
and Thomson (1961). Here the three primaries represent length, breadth, and 
depth. In this case there is only one hypothesis we can advance for the second- 
Order factor, namely, that it arises from the restriction placed on the range of 
dimensions in the boxes actually used. Since boxes are always produced for 
Some special purpose and are made of some special material which in itself limits 
Possibilities, the more extreme variants (e.g. half inch high by one mile long) 
will never arise. We thus get a necessary correlation between length, breadth, 
and depth due to sample restriction, This must always be mediated by the 


Ses * What Cattell calls the “ associated factor variance ” as opposed to the “ disassociated factor 
ariance," 


Bue One merit of the Cattell- White transformation is that it parallels the variance which would be 
ani 


€d by direct measurement at the higher-order level. 
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primary factors, so that we have here a true second-order relation. And notice 
that we are forced to this conclusion even if we have obtained our results by the 
bifactor or group factor method. Obviously a general factor can be interpreted 
by second-order analogy. 

Tt will be useful here to consider some implications arising out of the trans- 
formation proposed by Schmid and Leiman. This apportions the variance 
between the contributions arising from the group factors of length, breadth, and 
depth, and the contribution arising from the sampling restriction. This is here a 
useful distinction. It is one thing to deal with variables because they involve 
the common dimensions of length, breadth, and depth, and another to deal with 
them as related to one another by reason of the concomitance of these three 
dimensions. For certain purposes these covariances are what primarily 
concern us, and the sampling effect is just noise to be eliminated. Whether we 
should concern ourselves with the ‘ unique’ variances (Schmid and Leiman, 
1957) or with the ‘ total ’ variances for each factor must depend on circumstances. 
For studying theoretical implications the former will usually be needed; for 
practical applications the latter may be preferable. 

To what extent does this second-order interpretation apply to Spearman’s 
‘g’? We might suggest that some at least of the variance might derive from a 
concomitance of aptitudes genetically derived and tending to affect sometimes 
more than special aptitudes or faculties. Despite the old adage, beauty and 
brains are positively correlated; and it is quite likely that some of the ‘ g ’ effect 
is akin to the general ‘boxiness.’ Spearman’s ‘cognitive energy’ would also be 
an example of second-order explanation; but there is little or no evidence that it 
is more than an analogy. Rate of neurological functioning could produce similar 
effects if we always use speeded tests; but refinement in testing should separate 
anything like this as a distinct speed factor. Complexity of the neurological 
system as a whole (Burt's theory) might also be considered, and could be compared 
to the parallel increase in capacity among electronic computers where again several 
functions will work better in the newer and high-capacity computers; but this 
again is really similar to the ' boxiness’ concept. 


1 The parts tend to improve 
concomitantly. 


A True General Factor. With a true general factor we have a source of variance 


which spans the variables involved in several group factors, but without any 
necessary relation to their variance. "The general factor is itself an independent 
source of variance. We have already suggested an illustration, A similar 
situation might exist if a group of people whom we were examining for foreign 
language efficiency had developed this by two main methods—study in their 
respective schools and varying lengths of time spent in the foreign country 
concerned. Assuming that the time spent abroad was not a function of the 
school they had attended, it would probably emerge as a general factor. and the 
schools would emerge as group factors, : 
Possibly some part of the Spearman's ‘g’ could be explained in this way: 
The notion of intelligence as insight might also suggest a general factor of this 


it 
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of forms. Consider the cube test which has been used to 
visualization. If one has vivid, well controlled visual imag 


who fail to do the task by visual imagery may achieve excellent 
matical reasoning. Again a Person who has difficulty in the verbal application 
of the laws of deductive logic may compensate effectively b i 
Euler’s circles, and so substitute visual for verbal capacity. To the extent that 
this sort of thing occurs we may expect a general factor to be generated, This 
again may make some contribution to the Spearman’s ‘g’. It is allied to the 
insight effect, In fact, we might almost define insight as the factor which has 


of vicarious functioning. 


thus results can be represented as in Table III. 


TABLE Ill, CORRELATION PATTERN ILLUSTRATING THE OVERLAPPING OF EFFECTS 


Significant positive coefficients are indicated by X; 
non-significant coefficients by O. 
Variables 1 2 
1. Aggressiveness — X 
2. Freedom from Shyness X — 
3. Affectionateness G X 
4. Group dependency oO X 
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The question we have to ask is what happens when such a pattern of primary 
factor correlations turns up. There can be no doubt that variables two to faur 
would be involved in a general factor; and it is quite likely that aggressiveness 
would pick up some loading in the average matrix where it will probably have 
some small correlation with both three and four rather than the zero indicated 
here. Yet in what sense can we postulate that there is any common causation 
operating on even variables two to four? It looks much more like a common 
effect than a common cause. Affectionateness could be conceived as predisposing 
towards group dependency, but need shyness have any direct relationship to 
these two? Yet if we use measures involving social interaction, we shall 
probably get correlation in terms of the common result; and, since all the traits 
necessarily involve social interaction of some kind, we can hardly avoid intro- 


ducing such effects. Here then is another hypothesis which must be kept in 


mind when we are interpreting general and second-order factors. Whether 


the particular case we have presented is empirically confirmed is a matter for 
actual investigation and does not concern us here. 


IV. SUMMARY AND CONCLUSIONS 


I have tried to demonstrate that a second-order factor cannot be distin- 
guished from a basic or general first-order factor by mathematical criteria since 
the same data may yield either type of solution according to the method chosen. 
We are therefore thrown back on interpretational criteria. This being so, it can 
be argued that an oblique rotation of principal factors transformed, as advocated 
by Schmid and Leiman (1957), provides the most convenient representation. 
I have further referred to four types of interpretation to illustrate the range of 


the hypotheses which need to be considered in dealing with higher-order factors. 


In particular I have sought to show that a higher-order factor does not necessarily 


have to be equated with a ‘ common cause.’ 
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THEORETICAL CONCEPTS IN PSYCHOLOGY 


By RicHarp W. Coan 


University of Arizona 


Psychology can best 


of various types of 
concepts whose use is at Present too often rejected, notably concepts 


embodying existential hypotheses, or designating so-called ' private’ 
phenomena of consciousness. 


I. THE CLASSIFICATION of Concepts 


In recent years psychologists have shown considerable concern with the 
legitimacy of various concepts employed in their theories. Much of the discus- 
sion has centred round a distinction made by MacCorquodale and Meehl [27] 
between ‘ intervening variables ' and ‘ hypothetical constructs’. Its importance 
cannot be questioned: but a good deal of confusion has arisen owing to a failure 
to recognize the limitations of this dichotomy. The issues usually discussed 
involve a number of conceptual distinctions, some of which were not incorporated 
by MacCorquodale and Meehl in their classification. It is the contention of 
the present writer that many of the important issues relating to psychological 
concepts can best be treated in the context of a more comprehensive scheme; and 


it is the purpose of this paper to present such a scheme and then examine the 
Problems so raised. 


MacCorquodale and Meehl distinguished between (i) variables definable 
and quantifiable in terms of specified manipulations of empirical variables and 
(ii) concepts not reducible to empirical terms. Their recommendations 
Succeeded tosome extent in standardizing current usage. Anumber of comparable 
distinctions have been made by other writers, e.g. Carnap’s [10] * disposition 
terms’ and ‘ theoretical terms ". Objections have been raised with respect to 
the proposed dichotomy, in particular by Bergmann [2, 3]. A distinction made 
9n the basis of reducibility versus non-reducibility to observables meets with 
Certain difficulties. According to the assumptions and definitions one chooses 
to adopt, it can be argued either that nothing is really observed directly and that 
all the entities and processes of which we speak are inferences from our experience, 
or that all the meaning of our concepts and statements is ultimately reducible 


© immediate observation, or that all concepts contain a certain amount of 
S.P. L 
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irreducible surplus content in addition to a core reducible to observation. On 
any of these grounds it would follow that no firm distinction between hypothetical 
constructs and intervening variables can be maintained. Yet most psychologists 
seem content to assume that it has some practical value, even if it is to be regarded 
simply in terms of relative position along a continuum of abstraction or remote- 
ness from empirical operations. 


Restatements or modifications of the MacCorquodale-Meehl distinction 
have been proposed by such writers as Ginsberg [18] and Rozeboom [36]. The 
literature also contains suggestions for subcategorization within the two classes, 
as well as proposals that cut across the distinction. Rozeboom [36] points out 
that hypothetical constructs may vary with respect to type of underlying specula- 
tion and with respect to the level of uncertainty regarding their content. 
Alternative schemes of classification within the construct realm are O'Neil's [32] 
classification of hypotheses and classifications of models presented by such 
writers as Bertalanffy [4] and Zubin [41]. Other types of ‘ models "—as the 
term is defined by Braithwaite [6]—are included in a somewhat more compre- 


hensive scheme used by Argyle [1] in enumerating different types of theories in 
social psychology. 


It is obviously possible to classify theoretical concepts along many different 
lines. Indeed, in a less formal way psychologists often make typal distinctions 
not incorporated into any of the schemes cited above, and certainly concepts can 
be classified with respect to either ontological status, factual c 


5 5 ontent, mode of 
experience, source of experience, or the manner in which the concept is introduced 


into theory. A man’s epistemological and metaphysical assumptions naturally 
affect his preferences for methods of classification: phenomenalists and realists 
will prefer different schemes, and the scheme preferred by a logician will be 
declared useless by a psychologist. It is, in short, futile to argue that any one 
mode of classification is intrinsically more valid than another. We must there- 
fore be content to classify psychological concepts along lines that reflect the issues 
which face psychology at the present stage in its history. 


In the writer’s opinion a classificatory scheme that best serves the current 
needs of psychology must be constructed in terms of observational and ontological 
status. Accordingly, the scheme proposed will now be presented in outline as 
a guide to the discussion that follows. The specific distinctions made within 
it will be clarified later on when discussing the various issues relevant to the 
classification. The most fundamental distinctions may not be immediately 
apparent, since the writer has used a novel terminology to avoid words that have 
acquired conflicting usages. Within the scheme the main categories are capable 
of further subdivision and cross-classification should anyone wish to add further 
distinctions. In proposing this scheme of theoretical concepts, the 


: P writer bas 
conceived of a theoretical concept in a very broad sense. 


Vise iae Thus the scheme 40° 
not rest on any prior distinction between theory and model, between theory 4% 
> 


law, or between theoretical terms and observation terms. It is intended proadly 
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I. Adspective concepts 
A. Omnispective concepts 
1. Classificatory omnispective concepts 
2. Relational omnispective concepts 
B. Propriospective concepts 
Í. Classificatory Propriospective concepts 
2. Relational Propriospective concepts 
IL Ultraspective concepts 
A. Hypothetical concepts 
1. Specified hypothetical concepts 
2. Unspecified hypothetical concepts 
B. Fictional concepts 


Il. Tue OBSERVATIONAL Basis or CONCEPTS 


The fundamental distinction used in this scheme pertains to the observational 
foundation of the concept. An adspective concept is one definable in terms of 


definable, although it might consist of components that are, In short, the ultra- 
spective concept contains “ surplus meaning ” in the sense of factual content that 
goes beyond past observation, Thus, the concept unicorn is ultraspective, The 


as adspective, In general, the “surplus content ” might involve any of the 
three levels of uncertainty for the existence of a hypothetical Construct discussed 
by Rozeboom [36], or it might take a suppositional form in the case of a model 
adopted for convenience. It involves something which has not been observed 
With respect to the objects to which it is applied, but which may or may not be 


Y adspective and ultraspective concepts. 

It is not assumed that a sharp dividing line can be drawn between 
adspective and ultraspective Concepts. In a sense every concept contains 
Surplus meaning, for even the simplest communicable concept embodies con- 
Siderable abstraction and induction which carry it far beyond any immediate 


c i H . . B 
Pncept is actually a construct in so far as It represents an inference regarding a 
sica] reality underlying our experience. In any case, the ultraspective 
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concept is viewed here as one whose surplus content, from any philosophical 
viewpoint, exceeds the bounds of mere abstraction or generalization from past 
observations. Outside an intermediate range, the distinction between adspective 
and ultraspective concepts should not be difficult to apply. 

It should be noted that this and other distinctions are made here on the basis 
of the denotative content accorded a concept by the theorist in his explicit 
definition and use of it. Any adspective concept may have considerable surplus 
connotative content. This connotative content, though irrelevant to present 
concerns, may arouse needless ‘controversy when misconstrued as denotative 
content and may subtly affect the course of scientific pursuits as it gradually 
becomes denotative. Kendler [23] has noted the tendency for controversies 
in the field of learning theory to arise because of a failure to distinguish between 
operational meanings and the “ intuitive properties” ascribed to the concepts 
utilized by such men as Tolman and Hull. Meissner [31] and others have pointed 
to a rather pervasive tendency toward a reification of theoretical concepts and 
introduction of surplus meaning that has previously been formally excluded. 
Much of this process undoubtedly involves a gradual conversion of connotative 
meaning to denotative meaning, and while it is conducive to certain difficulties 
in communication, it may also be fundamental to scientific progress. 

Most of the controversy regarding the relative virtues of intervening 
variables and hypothetical constructs has centred about the adspective- 
ultraspective dimension. "There are those like Marx [29] who regard operation- 
ally valid intervening variables as “the only kinds of constructs ultimately 
admissible in sound scientific theory”. They may feel, as he does, that hypo- 
thetical constructs are tolerable as a temporary expedient, or they may advocate 
a strict exclusion of speculative content at all times. Others, like Maze [30], see 
a danger in the use of the intervening variable. Maze feels that it is likely to 
be perceived as providing explanation or extending knowledge when it actually 
provides only a restatement of fact. Still another viewpoint is that of Hebb [20], 
who favours the use of hypothetical constructs, but believes that mere “ tauto- 
logical constructs ” may serve a valuable purpose. 


The general trend in recent psychology has apparently been toward greater 
acceptance of hypothetical constructs and a recognition of the vital role that they 
play. While many still feel that we should strive toward theories that will 
ultimately be devoid of ultraspective concepts, there is a growing suspicion that 
the notion of an ultimate science or an ultimate theory may beillusory. Further- 
more, there seems little doubt that whatever the merits of reconceptualizing 
ultraspective concepts as adspective concepts, science progresses as much by the 
opposite process.  Bertalanffy's [4] examples of the transformation of formal into 
material models are at least illustrative of this; and Feigl [14] has presented argu- 
ments in favour of converting intervening variables into hypothetical constructs. 
Perhaps scientific progress may best be regarded as involving a helical trend in 
which surplus factual content is repeatedly infused and later expelled or accepted 
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as fact on the basis of accumulating observations. It might be argued that a 
science that ceases to move in this manner by constantly reaching beyond the 
limits of extant evidence has ceased to fulfil one of its basic functions. 

We may note that the recent emphasis on the intervening variable and the 
later and more liberal advocacy of hypothetical constructs has been paralleled by 
shifts in attitudes toward operationism. The operationist position, of course, 
is subject to many shades of interpretation. In its more liberal forms, it is quite 
consistent with the use of hypothetical constructs as long as they point fairly 
clearly in the direction of confirming operations that have not yet been performed. 
In recent years, however, there has been a growing tendency to permit the scientist 
to employ any kind of concept he sees fit to use. Logicians like Carnap [10] 
have pointed out the dangers of regarding empirical meaning as totally reducible 
to operational definition. While the value of operationism is generally recognized, 
there has been increasing recognition of the inherent absurdity and potentially 
stifling effects of a strict operationism—both noted by Ginsberg [19]. 


III. VARIETIES OF ULTRASPECTIVE CONCEPTS 

Closely linked to the issue of adspective versus ultraspective concepts are 
a variety of issues relating to the choice of ultraspective concepts. The basic 
distinction drawn here is between hypothetical and fictional ultraspective concepts. 
In the hypothetical concept the surplus factual content refers to entities, events, 
or relations that are regarded as potentially observable, whether or not the means 
of observation are available. The fictional concept, on the other hand, refers to 
entities, events, or relations which are assumed not to correspond to fact and to 
be unobservable either currently or potentially. The fictional concept commonly 
assumes an analogical form, in that the things to which reference is made have 
been observed in a different realm and provide an understanding by way of a 
comparison. Many so-called ‘models’ are composed of fictional concepts. 
The hypothetical construct is sometimes construed as the equivalent of what is 
here called a hypothetical concept; but by the definition of MacCorquodale and 
Meehl [27] it encompasses the fictional concept as well. 

A further distinction within the class of hypothetical concepts seems 
desirable; and it is proposed that they be subdivided into specified and un- 
Specified hypothetical concepts. A specified hypothetical concept is one for 
Which the definition contains a relatively specific statement of the properties 
that must be observed to provide confirmation. In the case of the unspecified 
Concept there would be minimal indication of these properties; and the hypo- 
thetical element would be confined to a general indication of the type of properties 
to be sought or of the region in which they might be found. This distinction 
'S essentially the same as that of O’Neil’s [32] ‘ characterized ' and * uncharacter- 
ized’ hypothetical terms. Thus, a‘ memory trace ' defined as some unspecified 
alteration of nervous tissue, would constitute an unspecified hypothetical concept. 

he unspecified hypothetical concept bears some kinship to the formal physio- 
logical concepts advocated by Pratt [33], to Lindzey's [26] conventional construct, 
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and to the constituents of Bertalanffy’s [4] formal models; but it is not strictly 
equivalent to any of these. 


Specified and unspecified concepts represent regions along a continuum 
of explicitness, rather than completely separate and discrete categories. At the 
unspecified end of the continuum, hypothetical concepts shade into adspective 
concepts in which the hypothetical element is strictly connotative. Since the 
intentions of psychological theorists are often obscure, many borderline cases 
will be encountered. A similar problem arises with fictional concepts, since it 
is often difficult to determine whether a theorist intends explicitly to adopt a 
model concept, or merely to preserve a model concept in his choice of words 
and exclude it by formal definition from denotative reference. 

In discussions of the relative merits of hypothetical and fictional concepts, 
it is the fictional concept whose value is most often questioned. MacCorquodale 
and Meehl [27] assert that hypothetical constructs “ should not assume inner 
events that cannot possibly be true." They thus recognize the value of what is 
here called the hypothetical concept, but they reject the use of fictional concepts. 


In particular they object to the incorporation of certain psychoanalytic concepts, 
such as libido and censor, into physical models. Krech [25] presents a similar 
viewpoint in objecting to notions of existing structures that are non-behavioural, 


non-experiential, and non-neural. Bridgman [7], Zubin [41], and Braithwaite 


[6] have spoken of the virtues of models in a way which shows they see a potential 
heuristic value in the use of fictional concepts. 


At the same time, they recognize 
certain dangers inherent in their use. 


Bridgman and Braithwaite stress the 
difficulties arising from literal acceptance of the model as a physical reality, 


while Zubin points out the stagnation resulting from the use of a model that is 
not sufficiently testable to allow its own possible demise. 


In his early pleas for the use of existential hypotheses, Feigl [12, 13] 
advocated the use of hypothetical concepts in general, though he pointed out 
the risks of using those requiring operations remote from present technology. 
On the other hand, he explicitly rejected the use of concepts unconfirmable in 
principle, citing animistic and vitalistic concepts as examples. He has also 
commented (Feigl [14]), that certain fictional concepts may have great heuristic 
value, as with Freudian analogical models. What appears important in his 
standpoint is that the fiction be recognized as such, so that we are prepared to 
replace it with existential hypotheses when the time is ripe. The basic defect 
in the concepts criticized by Feigl—the later ether hypothesis, soul, entelechies, 
etc.—is that they are improperly accorded an assumed or hypothetical existential 
status. If we rely on the intention of the conceptualizer, they must be classed 
as unconfirmable hypothetical concepts, or, in some cases, adspective concepts. 

A different position is presented by Mandler and Kessen [28], who argue 
that the existential status of a model concept is irrelevant to its value within 
theory. Libido, whatever hydraulic properties we assign to it, meets the require- 
ments of sound theory if it yields testable and confirmed statements regarding 
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the behaviour it is intended to explain. Presumably Mandler and Kessen would 
criticize some of the concepts that F eigl criticizes, but chiefly on the ground of their 
inability to generate testable statements, rather than their unconfirmable existen- 
tial status. 

Another issue that has attracted attention is the kind of factual content 
that should be embodied in hypothetical concepts. Hypothetical concepts of 
physiological content have been advocated by such writers as Pratt [33, 34], 
Tolman [39], Krech [25], Klein and Krech [24], and Hebb [20]. A few have 
equated the hypothetical construct with physiological hypotheses. The formula- 
tion of MacCorquodale and Meehl [27], however, implies no such restriction; 
and it would be contrary to the present classification to impose it on the use of 
the term hypothetical concept. Furthermore, I should agree with such writers 
as Lindzey [26] and Rozeboom [36] that, whatever value physiological hypotheses 
may have, they do not constitute a course that all psychologists must follow. 
In psychology the surplus content of useful hypothetical concepts may relate to 
behavioural events, experiential events, social processes, or various kinds of 
Tunctional relations. Unless we make explanation and reduction synonymous 
by definition, it is absurd to assume that the physiological route is the only one 
to take inseekinga better explanation. If ‘explanation’ is to be defined in terms of 
stated functional relations in general, it would be presumptuous to suppose that 
reductive explanation—i.e., explanation in terms of correlations between physio- 
logical and psychological events—is the only kind still lacking. To take but one 
area in which we might fruitfully deal with behavioural hypothetical concepts, 
there is the problem of inborn behavioural predispositions: here our knowledge 
of the bare facts is still at a primitive level; and, despite the ostrich-like 
Manoeuvres of some behaviourists, the problem still persists. . 

Germane to the choice of physiological or non-physiological concepts is 
the question of ultimate physiological reduction as a goal of psychology. With 
Lindzey [26], Rozeboom [36], and Mandler and Kessen [28], the writer would agree 
that there is no basis for assuming that physiological explanation will inevitably be 
the most effective kind (in terms of its capacity to generate predictions), nor will it 
necessarily serve the same purposes as non-physiological explanation. As Hebb 
[21] has recently noted, physiological concepts cannot take the place of 
Psychological oes. Along with the increased interest in physiologizing, there is 
à growing feeling that the goal to be sought is not a mere reduction of psycho- 
logical to physiological formulations, but a greater mutual translatability of 
Psychological and physiological formulations, and the construction of theories 
comprehending both physiological and behavioural events. 


IV. VARIETIES OF ApsPECTIVE CONCEPTS : 
. , The classification of adspective concepts presents special problems, since 
It depends on judgements regarding the nature of observation. As Hempel [22] 
38 noted, the concept of observation may be construed in a variety of ways. 
t may be construed broadly, or limited to what is publicly ascertainable. Because 
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of the problems inherent in the concept of observation, some of the ei 
considered here to lie within the realm of adspective concepts are often confuse 
with issues involving the adspective-ultraspective dimension. M 
The object sought in classification of concepts was to introduce distinctions 
which, on the one hand, would be conducive to unambiguous and comprehensive 
categorization of concepts, and at the same time would be relevant to the issues 
on which psychologists are forced to make decisions. With respect to varieties 
of observation, the basic issue is one commonly represented by such elastic 
terms as public versus private, objective versus subjective, behavioural versus 
experiential, etc. Unfortunately, despite a core of meaning that seems to run 
through these terms, a host of overlapping distinctions is bound up with them 


as they are commonly applied. The need for introducing novel terms if we are 
to focus on a well defined and useful distinction is obvious. 


It would be possible to formulate a distinction between omnispective and 
propriospective concepts in a variety of ways, and there are special problems 
imbedded in all of them. Obvious distinctions between the internal and the 
external or peripheral prove to be irrelevant, whether the skin or the ego- 
boundary is taken as a dividing line. The usual formulations lead us to think 
primarily of the social observability or confirmability of the entity embodied in 
the concept. The latter is not helpful; for if it is taken to imply repeatability 
by more than one observer, it must be present in every psychological concept. 
More fundamental than mere duplication of verbal report is the question whether 
the thing observed and reported is the same for any two observers. We are 
inclined to assume that it is the same when we speak of a “ chair " or a “ prehen- 
sile movement ”, and that it is not the same when we speak of a “ body image ” 
or “ feeling of grief ". The fact with which we are forced to reckon, however, 
is that there is no operational means by which we can distinguish directly between 
the two presumed realms of experience. Though we can compare subsequent 
behaviour, verbal or otherwise, we can never compare the actual experiences or 
observations of two people so as to establish their identity. Nevertheless, 
it seems important to distinguish between the table that we both sce and the pain 
that we experience as individuals, even though our experiences in both instances 
are inevitably private. The important point is that, despite commonsense pre- 


suppositions, the distinction cannot be made in terms of the conditions of obser- 
vation; it must rather be made on the basis of conce 


Thus, as the distinction is formulated here, the omnispective concept is one whose 
observational content is conceptualized as public; and the propriospective concept 
as one whose observational content is regarded as subject to i A A aA 
vation only. J o individual obs 


ptual or theoretical operations. 


'This distinction rests on a realistic basis so f. 


between experience and the object éxperienasd ar as it assumes distinction 


it may appear rather pointless, although it can ^s s a strict phenomenalisi, 
conceptual operations applied to phenomenal bi 50 be expressed in terms O 
o 


jects. In any case, as long 25 
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the bulk of Psychological theory continues to rely on essentially realistic assump- 
tions, the categories here Proposed may have useful applications. Within the 
framework of present-day Psychology, it is Possible to apply them either according 
to the evident intentions of the formulator of a concept or according to the 


include Proper names and their equivalents as single-member Classes. Thus 
they embrace much of the same realm that various philosophers Speak of in 
terms of observation language. Ag commonly used, chair, neurone, Yohn Smith, 
Methodist, arm movement, and red object are Classificatory omnispective Concepts ; 
pain, anger, phenomenal self, and green after-image are classificatory proprio- 


The relational concept is one in which the defining Operations exceed 
abstraction and classification ; they introduce a relation or conjoint function 
involving two or more of the things or events designated by classificatory terms. 
It is thus definable in terms of classificatory concepts, and may ultimately be 
related to extant observation in the same way as the classificatory concept, 
The relational function may assume any of a variety of forms: €.£., an interactive 


thus be relational omnispective concepts. Comparable Possibilities exist for the 


Propriospective components, and must thus be considered either mixed classifica- 


If we are interested in logical completeness of classification, then it should 

€ noted that the omnispective-propriospective dichotomy cuts across the 
adspective-ultraspective dimension, and is potentially applicable to the ultra- 
SPective realm as well. It would seem Possible to subclassify hypothetical 
Concepts ag omnispective and Propriospective, according to the assumed nature 
of the unobserved event, This is not Proposed here, because the practical wale 
of the resulting subcategories seems questionable, and would lead ree 
that do not arise when the omnispective-propriospective distinction is applied 
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to adspective concepts only. It seems likely that a slightly different distinc- 
tion—such as that which Smith [37] makes between objective and subjective 
constructs—would prove more useful in the sphere of hypothetical concepts. 
As the hypothetical concept is here defined, its content could obviously 
refer to entities or events conceptualized as observable either publicly or only 
privately. Examples of the former—unobserved planets, unobserved neural 
structures—come readily to mind. Within the body of personality theory 
there are concepts that might be construed as examples of the latter sort. In 
Jungian theory, for instance, we find such things as ‘ archetypal’ concepts and 
the ‘ self’, which can be defined in terms of experiences that most people have 
not had, but could have. In general, however, a theorist does not formulate 
such concepts unless the potential observations lie within the range of past 
observations. The concepts themselves might then be regarded as adspective. 
Unfortunately, we commonly experience greater difficulty in communica- 
tions about things we consider privately observable than we do about things 
we consider publicly observable. Our rudimentary concepts seem less precise; 
and we assume a more critical attitude toward reports of things we have not 
observed ourselves if the things described lie in the private realm. Thus, we may 
not hesitate to accept the report of a single astronomer regarding a previously 
unreported celestial body ; yet to a British or American psychologist the concurring 
reports of many continental phenomenologists seem to contain a great deal of 
hypothetical, if not meaningless, content. Since the difference between the 
public and the private is not to be found in the conditions of observation per se, 
consistent classification seems to demand that we should classify a concept as 
adspective whenever it is defined in terms of observations that someone has made. 


It is probably correct to say that behaviourism, more than any other move- 
ment in psychology, has brought attention to bear on the omnispective-proprio- 
spective distinction, and raised the question of the values of these two classes 
of adspective concepts for science. The term behaviourism, however, embraces a 
great variety of viewpoints; and, as Feigl [16] has noted, itis capable of at least three 
different interpretations—materialism, logical behaviourism, and methodological 
behaviourism. Materialism denies the existence of “ raw feels”, and would 
presumably lead to a rejection of propriospective concepts as devoid of meaning. 
Logical behaviourism insists on defining concepts in terms of physical observation, 
and it implicitly denies the omnispective-propriospective distinction, since it main- 
tains that a so-called propriospective term is meaningful only so far as it is 
reducible to omnispective terms. Methodological behaviourism leaves open the 
question of the existence of “ raw feels”, but it holds that only those types of 

behaviour which are expressible in omnispective terms are scientific subject 
matter. Combinations of these three positions are obviously conceivable. 
Psychologists who support the behaviourist movement generally favour à 
methodological behaviourism; philosophers who support it more often stress 
logical behaviourism, e.g. Bergmann [2] and Carnap [11]. Carnap, however, 


Theoretical Concepts in Psychology T2 


describes his position as physicalism rather than as behaviourism, and is clearly 
critical of methodological behaviourism (Carnap [10]). Feigl [16], on the other 
hand, considers all three unacceptable. 

A common extension of logical behaviourism is that which advocates the 
use of public corollaries of private events either as operational equivalents or 
as behavioural indicators of experience: €.g. Boring's proposal [5] to reduce 
experience to discrimination, and recent discussions about the use of verbal reports. 
Such an approach may help to broaden the scope of behaviouristic psychology; 
but its dangers have been stressed by Pratt [35] and Zener [40]. 

Many writers, including Tolman [38], Pratt [33, 35] and Feigl [12], have 
pointed out that all sciences are ultimately rooted in private experience. Hence, 
psychology must likewise rest on the private experiences of psychologists and 
their experimental subjects. If we accept this view and yet regard science as a 
public enterprise, we must identify its public character with something other 
than its ultimate source of data. This is done in various ways; but almost 
inevitably it is viewed in terms of the communicative aspects. Some writers, 
like Carnap [11], focus attention on science as a logical system of sentences. 
Others are more concerned with social concordance. Pratt [33, 35] stresses 
reproducibility of report as the hallmark of science; and for him reproducibility 
requires a statement of operations that will permit other investigators to duplicate 
the observations and so confirm or refute our own report. He excludes from 
the category of scientific subject-matter “ experiences which can be had by one 
person only”, but not because they are private: private experiences such as those 
studied by early introspectionists and rejected by behaviourists are in his view 
Scientifically respectable, just because they do lend themselves to reproducible 
reports. 

Others, like Braithwaite [6] and Zener [40], also hold that the public charac- 
ter of the data is not an essential requisite. Braithwaite instead emphasizes the 
application of hypothetico-deductive method., Zener stresses the “ repeatability 
of obtained functional relationships between specified experiences and specified 
conditions (external and internal)”. A similar idea seems implicit in Feigl’s 
suggestion [17] that all sorts of mental states and events will be found to fit 
neatly into the framework of experimental science and are able to satisfy our 
demands for confirmable statements, provided we view them as components in 
a general network of lawfully related facts. 


At present there appears a growing consensus to the effect that, whatever 
ands science may make of the theorist, the circumscription of subject matter 
imposed by behaviourism is not one of them. Even throughout the era in which 
behaviourism seems to have cornered the market for textbook definitions of 
Psychology, psychology has never really ceased to be at least partly a science of 
€xperience. The recent pleas by Burt [8], Zener [40], Feigl [17], and Hebb 
[21] form the more conspicuous crests in a tide that has long been rising. 

TOm a strict behaviourist standpoint it would seem that the scientist should 


dem 
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confine his attention to the afferent impulses that arise from his exteroceptors, 
preferably those reaching the brain by way of the second cranial nerve. The fact 
remains, however, that man possesses rich and widely varied experiences, for 
many of which there seems no adequate vehicle of interpersonal communication. 
If the psychologist is not sensitive to these experiences, he can hardly hope to 
deal with them scientifically at all. The writer fully agrees with Zener [40] 
that to advance in our scientific treatment psychology will need more “ experien- 
tially sensitive observers”. Hitherto we have successfully kept many out and 
desensitized such observers among our graduate students by rigorous methodo- 
logical training. 

It could be argued that, since any definition of science is arbitrary, science 
ought to be construed in such a way as to exclude a direct concern with experience. 
If so, then it should be granted that science furnishes a poor foundation for any 
application concerned with problems of human existence. If the psycho- 
therapist is to view his client as something more than an object that needs a bit 
of conditioning or synaptic reassortment, he will need training in a philosophical 
co-discipline that does concern itself with the appropriate subject matter. 


V. EVALUATIVE CRITERIA IN SCIENCE 


Many of the issues that have been discussed revolve around questions 
regarding the criteria that a theorist should employ in making differentially 
evaluative judgments. Some can be clarified if we focus on evaluative criteria 
themselves. The criteria that have received greatest attention are those relating to 
the acceptance of theoretical formulations. Though the distinctions are some- 
what arbitrary, it is convenient to think of them as falling into three groups: 
syntactic, semantic, and pragmatic. The syntactic criteria are concerned with 
the structure of the theory as a symbolic system; the semantic criteria with the 
relation between this system and the realm of observations as data to which it 
relates; and the pragmatic criteria with the effect of the theory on scientists—i.e., 


with the theory's heuristic value. Thus all commonly advocated criteria are 
encompassed in the following list: 


I. Syntactic criteria: A. Simplicity, conceptual economy; B. Internal 
consistency. 


II. Semantic criteria: A. Testability, verifiability, or confirmability ; 
B. Explicitness, operational clarity of concepts; C 
findings; D. Comprehensiveness. 

III. Pragmatic criteria: A. 
‘Theoretical productiveness. 


Incorporation of known 


Immediate research productiveness; B- 


Such a list could be reorganized in different ways, for the criteria are variously 
interrelated; and there is little agreement regarding the weight that should be 
attached to any of the criteria. Indeed many theorists regard some of them as 
actually irrelevant. On this abstract level we tend to regard the pragmatic 
criteria as not germane to the problem of judging the goodness of a theory. 
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Yet our judgements of theories are probably tempered by a knowledge of their 
influence. If we base our judgements solely on syntactic and semantic criteria, 
there is still room for extensive variation; and if we regard a theory not as a 
mirror held up to nature, but as a structure superimposed on nature for human 
Purposes, it becomes obvious that the personal characteristics of the theorist 
must largely determine such things as the relative emphasis on descriptive and 
predictive precision or simplicity. 

The mood of British and American theorists would lead us to emphasize 
chiefly semantic criteria, especially the first two listed above. Unfortunately 
it is with respect to these two that there is the greatest uncertainty. The first, - 
which we have called testability, verifiability, or confirmability, relates to the 
truth value of a theory. It is now generally agreed that truth as such is not a 
criterion generally applicable to scientific theories. Psychologists commonly 
insist that a theory should be verifiable—i.e., that it should yield predictions 
whose conformity to fact can be directly determined. On the other hand, 
philosophers like Carnap [9, 10] and Feigl [15, 17] have argued that theories 
are best viewed as conceptual systems possessed of free construction and only 
indirectly tied to underlying observations. They thus propose the somewhat 
weaker criterion of confirmability. This is more widely applicable, for it 
permits a graduation of judgements with respect to theories manifesting little 
direct verifiability. With this criterion we might perceive merits in certain 
ultraspective formulations that would otherwise be rejected. The concept of 
testability refers simply to the possibility of performing relevant empirical 
operations, and may be viewed as complementary to the other two. 

The criterion listed above as IIB concerns the demands to be placed on the 
ingredients of the scientific vocabulary. It could be formulated in terms of the 
clarity of the relation between the theoretical term and observation j and, where 
a choice is possible, we should no doubt prefer a concept manifesting this kind 
of clarity toa high degree. It is possible, however, that the desired characteristic 
is better assessed in terms of stability of usage than by analysis of definitions. 
Mandler and Kessen [28] insist that the basic requisite of scientific concepts is 
“ reliable usage . . . in particular observational circumstances and in the sentences 
of a theory "'. 

Invariance of usage is a syntactic characteristic akin to internal consistency; 
but it is a likely consequence of what is here called explicitness. And certainly 
it may furnish a more broadly applicable standard than explicitness. It may be 
difficult to evaluate the operational clarity of many propriospective terms by an 
analysis of definitions, but reliability of usage is indirectly evidenced in the 
Concordance of formulations containing these terms. ^ 

Some of the issues discussed in preceding sections concern a choice among 
the criteria listed above. In the case of the question of adspective versus 
ultraspective concepts, several semantic and pragmatic criteria are involved. 
Ultr aspective concepts can probably be best defended on the grounds that they 


174 Richard W. Coan 


afford comprehensiveness and heuristic value. An avoidance of such concepts 
is most likely to be maintained on grounds allied to verifiability and explicitness. 
Adspective concepts will usually fare better in the light of these two criteria. 
But there is still great variation in explicitness within both the adspective and the 
ultraspective realms; and an unverified concept may be highly verifiable. 
The more specific question of the value of fictional concepts involves the 
same issues. The usual defence for such concepts 1s their heuristic value; and 
the objections commonly raised against ultraspective concepts are most often 
levelled at fictional concepts. However, it is clear that one’s final judgement 
regarding the merits of a theory depends not only on the weight attached to the 
criteria, but also on the particular way the criteria are applied. As Mandler 
and Kessen treat the first two semantic criteria, a fictional concept might be 
judged quite favourably. A fictional concept is inherently unverifiable; but they 
argue that the criterion should be applied to theoretical statements containing 
the concept rather than to the existential status of the conceptitself. Verifiability, 
they imply, is not separable from reliability of usage, which may be high for a 
fictional concept, even though operational clarity must be low. 


Turning to omnispective versus propriospective concepts, we find that the 
problems of evaluation become more complex. Several different kinds of 
evaluation are involved; and these have seldom been properly separated. We 
need to distinguish at least three questions. "The first is the one on which we 
have focused attention—the acceptance of theoretical formulations; a second is 
the acceptance of subject matter for scientific investigation; a third, the 
acceptance of observational data as usable or useful. 

The second is the most fundamental, since it relates to the nature and purpose 
of science itself, We could argue that no criteria should be devised for the 
acceptance of subject matter. The history of science suggests that its purpose 
is to bring systematic order into all the contents of human experience. There is 
no area of experience which scientists have universally agreed to exclude. Tradi- 
tional taboos or theological doctrines may have delayed the entry of certain areas. 
Development has usually begun earliest, and proceeded most rapidly, in areas 
least concerned with man’s own place in the universe. But the history of science 
is an account of an ever-expanding subject matter. Psychology is on an outer 
frontier, and psychologists have sometimes drawn their own boundary lines, 

lest others should doubt that they are part of the continent of science. 


The criterion regarded as basic for observational data is repeatability. To 
be of use to the scientist, this criterion must be flexible. If we accept no 
restrictions on subject matter, we can demand repeatability of observations 
only to the extent that it is possible to obtain it. Physical scientists in fields like 
astronomy and geology have used data of low repeatability. The carefully 
controlled experiment insures a high level of repeatability; but it is not 4 sine 
qua non. An overemphasis on rigid controls can result in a neglect of problems 
involving complex inter-relations and inadequate observation of events that are 


Tocesses, and inner experience Constitute three 

ation, and three realms of subject matter, Each Warrants 

Scientific investigation and an attempt at explanation, The last may involve 

events which are no more controllable or repeatable than earthquakes, and may 

yield formulations which are no More Verifiable than 4 celestial event observed 

by a single lonely astronomer. The fact that it challenges the ingenuity of the 

investigator should not Constitute a permanent barrier in the path of intellectual 
Progress, 
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NOTES AND CORRESPONDENCE 


THE STABILITY OF FACTORS 
By CYRIL Burr 


In one or two early papers I described and illustrated a method of assessi 
the degree of stability shown by homologous factors obtained in diffe 
investigations (Burt, 1939, 1943); and in a later note in this Journal (Burt, 1954) 
I endeavoured to answer certain criticisms advanced by Mr. Leyden (Leyden, 
1953), However, both he and other correspondents have now raised a further 
problem, * Thomson, ” we are told, “ in his discussion of the problem follows 
much the same Pearsonian procedure as Burt in his 1934 Memorandum, and 
yet reaches the opposite conclusion. ‘An experimenter,’ he contends, * begin- 


factors’; the factors derived from a particular sample, such as he analyses, 
will differ widely from those which would be derived from the entire population 
or from any other sample " (Thomson, 1948, pp. 194 I). 

In point of fact, however, Thomson’s procedure is not the same as my own, 
My formulae and my proof, as given in the ‘ Memorandum on Correlations 
obtained from Selected Groups’ to which Mr. Leyden refers, Were generaliza- 
tions of the method of partial correlation, and were applied to correlation 
Matrices with communalities in the leading diagonal; these were then treated as 
Matrices of variances and covariances. Thomson used Aitken’s formulae, and 
applied them to correlation matrices with units in the leading diagonal. To 
obtain the factors, I adopted Pearson’s method of weighted summation, 
whereas Thomson commonly uses the centroid method. I assumed several 
common factors and eliminated specifics; Thomson’s analysis assumed only 
one common factor and included specifics, Finally, my proof did not require 
the numerical values or even the precise nature of the ‘ directly selected ’ variables 
to be known; Thomson’s analysis seems to have given the impression that the 
Values for the selective variables must be known or estimated at the outset. . 

The results of these differences can be more clearly explained if we consider 
first of all, not Thomson’s imaginary battery of tests, but the actual set of inquiries 
Which gave rise to the whole issue, To facilitate the comparison, however, I 
Shall substitute Thomson’s notation for my own. In 1917 I applied a group of 
Scholastic tests to a group of London school children and found four common 
actors? J assumed that these factors would hold good of the London school 
Population generally and of all the elementary subjects taught in the London 


Schools, From time to time I applied similar tests to other groups; and other 
S.P, M 
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investigators, Dr. Carey for example, did the same. Asa consequence hee = 
all wanted to know was whether the factors so discovered, which looked much the 
ly were the same. . 

Bot with this problem I imagined a matrix derived by s 
complete set of all conceivable tests applied to a population consisting of all t ; 
persons that might conceivably be tested; and I supposed that, in any actua 
investigation, the battery of tests employed and the group of persons tested uy 
suitably selected samples. The empirical correlation tables thus obtained 

regarded as submatrices of the ideally complete matrix of variances and co- 
variances. In our various researches the changes in factor values often appeared 


too large to be attributable to purely random selection; and the variables which 
might systematically affect the selection 


doubtless various unknown influences) I called the ‘ selective variables". Using 
Thomson’s notation (see his Table, loc. cit., p. 312) we can let Rpp represent the 
correlation matrix for the selective variables; Rgq the correlation matrix for 
a particular sample of tests before selection; and Ry the correlation matrix for 
the factors. The common factors obtained by factorizing Rqq (with com- 
munalities in the diagonal) are given by the equation 


(age, school, social conditions, and 


Rqq=F fF as, (i) 
and, since they 


are principal components, F' oF 
latent roots. 


af=Ryg, the diagonal matrix of 


the nature of the selection would be 
covariances from Rpp to Vpp (still 
qq Would change 
f a given age can 


orrelations of age 
selective; similarly for the influence 
tion can be assessed by generalizing 
- We then find (Pearson, 1912) 
Va = Rqq- Wap(Rpa— Vra) 


correlation 


(ii 

(iii) 

apRpp™! in Thomson’s 
(For proof, see Burt, 1943, 


= Ru- Won Rp — Vop)W' gp, 
where the regression coefficient, Wop in my notation and R 
formulae (loc. cit., p. 189), reduces to Fou, 
pp. 9-10, eqns. vii to ix.) 
Mutatis mutandis the same equation holds fo 
matrix obtained for the factors, i.e., 


: 3 Viz which takes 
of selection. Rearranging terms, we then have 


r the modified covariance 
the place of Ry as a result 


Fr (pp — Vp) Ermy =I- Vg, 
And, on substituting this value in eqn. iii, we obtain 


(iv) 


Vqq=F VF gp. (v) 


E ` 
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Evidently, if we factorized Vag we should obtain as our factor Saturations 
FoVip'?. Now if the method of selection happens to ensure that the factors i 
of Vy, are Proportional to those of Rpp, then Vr? will be a diagonal matrix, 
and the factors of V qq will be Proportional to those of Raq. Hence the direction 
cosines for the several factors will be identical (my definition of factor invariance), 
Under similar conditions of selection the same Proportionality wil] hold between 
the factors of Vaq and those obtained in any other sample, e.g., the factors of 
Thomson’s Vss or Vg. 

In general, however, V will not be diagonal. In that case, as T Suggested 
in this Journal (VIII, p. 86), Vy may be factorized by weighted summation: 
we then obtain Vip=HDH’, where H and D denote the latent vectors and latent 
roots. We can then take 


Raq = FH. H'F'4 and 
Vg = Fay HD", DETR s 


The rotation of the population factors wil] thus procure the requisite proportion- 
ality; and a similar procedure can be used in the case of the two samples. Butto 
retain proportionality for further samples, we should have to keep on changing 
the rotations. And these simply furnish us with factors that are essentially 


" better to prove or assess similarity than to postulate it and rotate accordingly ”, 
When Vj, is a diagonal matrix, then the Product of the two Covariance 
Matrices RaW qq=F yyy. Pa Vik’ oy will be Symmetrical, since, as we have 
Seen, PF" iP ay is also a diagonal matrix, When V; is not diagonal, then this 
product matrix will diverge from strict Symmetry; and to assess its approximation 
to symmetry —and therefore the degree of similarity between the two Sets of 
factors—] Proposed a proportionality criterion ’, obtained by calculating the 
unadjusted correlation between the sums of the columns and of the rows respec- 
tively (Burt, 1939, pp. 67-69 and Table IV). ] À 
Limitations of space have compelled me to give only a brief outline of the 
approach I have advocated. I have said nothing about the sampling of tests—a 
still more complex Problem; but, if we accept what I called the ` reciprocity 
principle ' and correlate not tests but Persons, much the same conclusions will 


unwise just to take any set of data because they happen to be at hand, factorize 
them, and then rotate the factors obtained to fit other data, or worse still the 
investigator's preconceptions, 

From the formulae themselves the reader may deduce for himself the 
Principles that should govern the selection of samples, The relevant factor 
Saturations of the selective variables, and the regressions which depend 
upon them, should be as small as possible; the differences between the covariances 
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for the selective variables (though not necessarily between these os 
should also be as small as possible; and the two sets of factor saturations i * meg 
in these covariances should be as nearly proportional as pra a p 
implies in practice I have explained in the papers already quote ) n p E 
of fact these seem to be the principles which most competent eee Sn a 

implicitly adopted. Hence, as a study of the literature shows, «^ pes 
actually ascertained, at any rate in the field of cognitive abilities, show = 
unexpected degree of invariance. Even in the imaginary sample worked out by 
Thomson himself there is a close approximation to proportionality: after selec- 
tion, the factor saturations derived from the new covariances are 0:33, 0-28, 
0-23, 0-19; and the * unadjusted correlation’ is practically perfect; (when derived 


from the new correlations, they are 0-56, 0-46, 0-37, 0-29, but the‘ unadjusted 
correlation’ is still over 0-999). 
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OBITUARY 
CHARLES WILFRID VALENTINE 


C. W. Valentine grew to manhood in a new era of British psychology. Ward's article 
in the ninth edition of the Encyclopaedia Britannica in 1886 was a watershed After its 
publication, psychology moved from the embrace of philosophy and aspired to be a science 
and mainly an experimental science. In spite of this, in 1900, when Valentine began the 
study of psychology, there were no chairs of psychology in this country. What is equally 
important, few looked to psychology for practical help, its applications seemed to most 
people to be of little account. To its rapid growth and recognition in the last sixty year? 
Valentine made an enduring contribution. 

He was born at Runcorn in 1879, and had a varied education proceeding in turn from 
Nottingham High School to Preston Grammar School, thence to Universit College: 
Aberystwyth, where he was an exhibitioner, and to Cambridge, whence he poesis with 2 
double first in philosophy and psychology. He taught for seven years in secondary schools; 
including a period at St. Olave's, Southwark, and then went to St. Andrews as a lecturer in 
psychology to the Provincial Committee for the Training of Teachers, and Assistant in 
Education at the University. It was during this period that he wrote Js first book, 4” 
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Promotion was not long delayed; and Valentine accepted the chair of Education in the 
Queen’s University of Belfast. After occupying this for five years, he came to Birmingham 
in 1919 and stayed in the area for the rest of his long life. Here he taught with distinction: 
he founded and edited the British Journal of Educational Psychology; he wrote widely and 
influentially; he greatly raised the prestige of education in the University; he was for some 
time Chairman of the City of Birmingham Higher Education Sub-Committee; and he was 


as a psychologist and in other ways. He took a keen interest in his advanced students 
from whose ranks not a few moved to influential Positions in educational administration, 
His lectures to intending teachers were clear and apposite: they were never disquisitions 
on academic psychology difficult of application; rather they were human in approach and 
enlivened by ad hoc inquiries about fear, curiosity, sympathy and the like. He remembered 
and was influenced by his own experience as a schoolmaster, In and out of the lecture 
room he was approachable, interested in his students’ personal affairs, and perceptive of 
ability. 

The founding of the British Journal of Educational Psychology in 1931 was indicative of 
the growth in this country of a new field of inquiry. Early this century there were links 
between education and psychology; and by the thirties these had been greatly strengthened, 
Valentine's heroic and devoted editorship of the journal over twenty-five years has been 
described elsewhere. Sir Cyril Burt said in 1956, when Valentine resigned from the editor- 
ship, “ the journal he started achieved not only financial success but a world-wide reputation 
for its scientific quality ". Needless to say, the financial success depended very much on the 
unpaid cooperation of the Valentine family. The world-wide reputation was the result of 
Valentine's own breadth of interest and his editorial skill. Many a former student can testify 
to the illumination given by articles in the symposia for which the journal was noted and to 
the enthusiasm aroused by the more technical articles. It can be argued that the journal was 
Valentine’s greatest contribution to psychology. 

Those who wish to know what Valentine himself thought about the nature and methods 
of psychology can learn from the presidential address he gave to the British Psychological 
Society in 1948 under the title ‘ Some Present-day Trends, Dangers and Possibilities in the 
Field of Psychology’. It is naturally a popular treatment, but it illustrates his ability to 
compound wisdom with humour and common sense with insight. “The true psycholo- 
gist ”, he said, “ should indeed love his work for its own sake ”; but “ psychologists are also 
human beings (though that may surprise some people) and most of us are eager to see our 
work helping some great pur; ose ", 

Mr. ich's $ List of Publications by C. W. Valentine ' (Brit. Y. educ. Psychol., 1956, 
26, Part 1) contains about seventy items, illustrating not only their wide range of subject 
matter but also versatility in technique. Valentine’s most substantial book is The Psychology 
of Early Childhood (1942). Itis a product of his systematic observation of his own five 
children and his extensive critical knowledge of writings about young children. It deals 
With their intellectual and emotional growth. The rapid development of new methods and 
Psychological frameworks since it was written has not destroyed its value as a rich source of 
Material, : 3 . 

Another important work is Psychology and its Bearing on Education (1950). This 
book made the author’s eclectic approach to his subject and his lucidity as an expositor 
available to a much greater audience, designed as it was for students in training colleges and 
University departments of education. If it gives undue weight to experimental work on 
this side of the Atlantic it complements similar books published on the other, 
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Here one cannot deal in detail with the multifarious interests of Valentine's po 
In the early thirties he was concerned with the reliability of examinations and wrote a boo à 
with this title. ‘The findings in the first half of it attracted much attention and set off other 
investigations, the results of which are now being seen in the changed attitude to the 
eleven plus examination. There are signs that the problems of university awards dealt 
with in the second half of the book will soon receive some attention. Clearly if huge sums 
are to be spent from the public purse on university education there will have to be conviction 
that selection and assessment are reliable. Valentine's inquiry was a pioneer effort, still 
to be followed up. :; " 

His interest in examinations was also expressed in Examinations and the Examinee 
(Birmingham Printers, 1938). One of his suggestions was the Quota Principle for the 
selection of children for grammar schools. ‘This was put into practice by a former student, 
Mr. V. J. Moore, who was then Director of Education for the County Borough of Walsall. 
"The essence of the scheme was to allocate a quota to particular primary schools and base 
the selection of the children for grammar schools on the school records and assessments. 
One could go on writing of Valentine's views: on the place of Latin in the school 
curriculum; of his restrained popularization of the psychology of the unconscious; of his 
early application of statistics to psychological experiments; of his intelligence tests; his 
views on discipline and bringing up children; on army morale and intuitive judgements. 
He treated all these topics and others shrewdly and lucidly, bringing to bear on them a 
scholarly and philosophical mind. : 

He was President of the Psychology Section of the British Association in 1930 
and President of the British Psychological Society in 1947-48. In 1954 he was made an 
honorary member of the Société Française d'Esthétique. ‘The University of Birmingham 
made him Professor Emeritus after he retired in 1946. 

The humanity of his writings reflected his personality. He was invariably helpful 
to his students, infinitely removed from the professor whose response to a questioning 
student was, “ I do not teach my subject, I profess it". He entertained students and staff 
at his house in Greenland Avenue, Selly Park, and his young colleagues greatly appreciated 
the opportunity of meeting their seniors at his table. He continued to lecture to the end of 
his life, enjoying this as well as watching cricket at Edgbaston. His friends and students will 


long remember the warmth of his personality and the encouragement they received from 
him. 


W. J. Sparrow 


To Professor Valentine this Journal owes a special debt of gratitude. Although he 
modestly disowned any claim to be himself a statistical psychologist, he was convinced from 
the very outset of his work that in educational psychology, as in most other branches, every 
conclusion should, so far as possible, be demonstrated or checked by rigorous statistical 
analysis. Since in the early days few readers of British journals were mathematically 
equipped, few British editors were willing to accept statistical papers. Valentine himself 
maintained that the more technical parts of the demonstration—the symbolic formulae, the 
algebraic proofs, the elaborate numerical tables—should be excluded from ‘ subject 
journals ' and relegated to a ‘ journal of method ’, edited not for the general reader but for 
the research worker or academic teacher. 

Accordingly, when a small group of British statistical psychologists proposed the 
publication of such a journal in this country, he strongly urged the Society to build uP 
a fund for that purpose. The war intervened. But as soon as it was over the project 
was revived; and, when Valentine became President, he succeeded in getting the present 
Journal launched—largely on the basis of financial help from the authors interested anc 
their various friends and benefactors. He assisted in drafting a statement of policy which 
gave the Journal a broad basis. His personal experience and advice were invaluabl 


e in 
drawing up plans for editing, printing, and publishing the new venture. 


Cyrit BURT 
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BOOK REVIEWS 


Personality Assessment: a Critical Survey, By P. E. VERNON, London: Methuen 

& Co., 1964, Pp. ix--333.. 425. 

Psychologists have had more than a Passing interest in personality assessment since 
the 1930's, and this interest has Breatly increased since the war, especially in the United 
States, despite growing disillusionment about specific assessment techniques, A compre- 
hensive description and appraisal of this field has been sorely needed; this need has now been 
admirably met by Professor Vernon’s newest book, 


Staying close to the data contained in the articles cited in his 28-page bibliography 


examines and appraises each of the major approaches to personality assessment, 

He begins by considering naive observers’ judgements of others, for their accuracy is a 
base-line against which the judgements of the Presumably more sophisticated Psychologist 
and psychiatrist can be compared. In addition, many of the factors that affect naive 
observers’ accuracy, the theories offered to explain their judging ability, and the ticklish 
methodological problems faced in quantifying judgements and evaluating their accuracy 
apply with equal force to clinicians’ judgements, 

Vernon then turns to assessments by clinicians. The clinical vs, Statistical Prediction 
controversy is brought up to date by his review of the reliability and validity of clinicians’ 
judgements, He concludes, in agreement with Meehl, that Predictions by clinicians are 


difficult, however, to accept Vernon’s view that such a conclusion implies that interpretations 
based on depth psychology or psychoanalytic concepts are ineffective, His view assumes 
that the Predictions of such variables as nosological categories, occupational success and 
Psychotherapeutic change were solely, or at least mainly, based on depth-psychological 
interpretations, but it is not even known, for example, that most of the clinicians in these 
Studies were psychoanalytically oriented, 


he concludes that these techniques are not useful in personality diagnosis, and, in fact, 
“ may detract from, rather than add to ” ordinary case-history methods and objective tests, 
although they may have some value as exploratory instruments in psychotherapy or in 
measuring rather Specific motives in research, e.g., McClelland’s measurement of need 


The effectiveness of Psychotherapy and counselling is also examined by Vernon, who 
Sees it as another index of the validity of clinical assessments. The link between the two 
Seems to be a tenuous one, at best, for the outcome of psychotherapy and counselling 


In attempting to understand why clinicians’ judgements seemingly go wrong, Vernon 
looks at the empirical evidence for some of the concepts of depth psychology presumed to 
Underlie their judgements, and comes away advocating the alternative approach to person- 
ality offered by the self-theories of Rogers, Kelly and others. Vernon's choice of self-theory 
'S Pragmatic and is largely governed by his views that counselling guided by this theoretical 
Orientation is relatively successful, while Psychotherapy and assessments based on depth 
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Personality appraisal with tests and questionnaires is not ee pss : ps T 
in detail the trait approach to personality measurement, exemplified by the tacto y 
E er 1l. and discusses at length such related problems as the test-taking 
ha a = e ; mes and social desirability response styles) that are creating 
P i al oit and various conceptions of validity. The psychometric 
ibn xn ndi RE E Snuch better than the other assessment approaches: Vernon con- 
Pm "iat tests and questionnaires do not have enough validity to justify their use in 
individual diagnosis, and that their major weakness lies in their instability. . 

The author also presents a novel model ofa personality system intended to integrate 
existing conceptions of personality. . This system consists of the interactions between such 
characteristics of the person as his behaviour, dispositions, self-concepts and personal 
concepts of others; and such environmental characteristics as stimuli and the conceptual 
system of others. 

Finally, Vernon discusses specific kinds of tests and other assessment techniques that 
he sees as useful in the light of the previous appraisals although not necessarily free of 
shortcomings. ‘These techniques run the gamut from more or less traditional psychometric 
tools (e.g., self-report inventories, Q-sorts, situational tests, and the Semantic Differential) 
to novel approaches employing cognitive styles and somatotypes. 

All but the most ardent psychometrician or clinician would have to agree, if only 
grudgingly, with most of Vernon’s carefully reasoned and balanced conclusions. Still, it 
needs to be stressed that these conclusions refer to the techniques used at present in person- 
ality assessment, most of which were developed years ago and do not mirror our current 
sophistication and technology. A great deal is now known about why these techniques go 
wrong and how they can be improved, as Vernon observes, but, unfortunately, there have 
been few attempts to use this knowledge in improving them. It seems premature to discard 
projective techniques or other assessment tools before it is certain that such attempts to 
improve them would be fruitless. For example, the psychometrically sophisticated 
Holtzman inkblots, which were recently developed to eliminate many of the pitfalls that 
plague the original Rorschach, should demonstrate the inherent potential of this projective 
technique. Similarly, our present knowledge about the way that a personality inventory 
should be constructed and our technology (computers that can factor-analyse large numbers 
of items, and efficient analytic rotation procedures) would make it possible to construct, 
along the lines of the test construction programme described by Vernon, an inventory that is 
homogeneous, minimally affected by response styles, and free of other problems that 
interfere with the effectiveness of current inventories. Experience with such an inventory 
would be a better guide to the usefulness of personality scales than our accumulated 
experience with such anachronisms as the MMPI. 

The book seems remarkably free of errors, but one worth noting was observed in the 
description of the Edwards Personal Preference Schedule (mistakenly identified as the 
Edwards Personality Preference Schedule). The text reports that the items in this forced- 
choice personality inventory were chosen, in part, on the basis of the items’ correlations 


airithe malesna WB pacial desirability, but published reports of its construction indicate 
that no such correlations were used in selecting items. 


i . Instead, the items were chosen on 
two bases: that their content appeared to reflect the traits, judging simply from an inspection 


of the items, and that their rated social desirability was appropriate. 

The manner of presentation could be improved. The prose: is ‘leas than ‘sprightly, 
there are some awkward and ambiguous sentences, some of the conclusions are so heavily 
qualified or otherwise obscured that they convey little meaning, and Vernon’s own concep- 
tion of validity and the term “ ‘notional’ criteria” crop up repeatedly but are 
never sufficiently defined or described. The book’s organization is also distracting. 
There is considerable overlap in the contents of the Foreword and the first chapter, which 
both summarize the entire book, and the chapters on validity and the personality system 
are poorly located. The validity chapter appears near the end of the book, though the 


oye 


"do 
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perspectives that it offers on validity would have been useful in reading the preceding 
chapters that hinge on the question of validity. Similarly, the chapter on the personality 
system would be more appropriately located near the chapters that describe the depth 
psychology and self-theory approaches to personality. 

The defects of this book detract only slightly from its considerable merits. The 
specialist in personality assessment will find it to be a useful reference, and a source of 
interesting and stimulating insights; other psychologists and students of psychology will 
find it to be a unique introduction to an important field of psychology. 

LAWRENCE J. STRICKER 


Famous Problems and Oth 
e Edi 7 : 7 
York: Chelsea Publishing Co., oez ees. Wei by Be, Sammin: un 


This volume, intended : a 
Primarily for 3 e 5 
monographs, and forms the latest bli ion im nts, consists of four mathematical 
: Publication in the useful series issued under the title 


of ‘ Chelsea Scientific Books’. To Statistic. 
- E t z al psych 3 e 
interest is the work published forty years ago Gwe the contribution of r 


Determinant to Tensor ’%. Itis in effect an introduction to 
peee. rep es by = Psychologist. Unfortunately its relevance 
s omew at concea y p ar terminology and notation which Sheppard insisted 
on using. 

: Among psychologists Sheppard seems to be known solely from the correction formulae 
Which bear his name and the valuable tables of the normal distribution which appear 
(more or less abridged) in almost every statistical textbook. He was, however, one of His 
Majesty's Inspectors of Schools, and in that capacity played an important part in the 
theoretical study and practical applications of mental tests. I personally am glad of an 
Opportunity to record the deep debt of gratitude which I owe to his friendship and 
inspiration. 

Before Sheppard's monograph was published all attempts at proving the algebraic 
formulae required for factor analysis were carried out by Pearson's method of writing out 
determinants and other arrays in full. "The change to matrix algebra, first suggested by 
Sheppard, enabled a proof which formerly occupied two or three pages to be condensed to 
little more than two or three lines—with a great increase in lucidity and a great reduction 
in the expense of printing. In adapting Sheppard's suggestion, I ventured to substitute 
Cullis's standard notation; Hotelling later on, in his proof of Pearson's method of* principal 
Components ’, preferred to employ tensor-notation, similar to that here used and explained 
by Sheppard. X 

In the present reissue Sheppard’s monograph is followed by one from Major 
Macmahon, entitled ‘An Introduction to Combinatory Analysis’. The clear and elegant 
treatment will make it useful for those interested in problems of probability. It should, 
however, be supplemented by a study of the more recent work on Combinatorial Chance by 

rofessor David and Dr. Barton. : 

The publication ends with three lectures on Fermat’s Last Theorem, given at Birkbeck 
College by Dr. Mordell. In or about 1637 Fermat scribbled in the margin of a book the 
Statement that the equation x” +” =2"(n> 2) cannot be satisfied by any integer, adding 
that he had « discovered a truly remarkable proof which this margin is too small to contain "'. 

"hat was his « proof’? As has frequently been noted, when Fermat had derived a formula 
JY induction only, he always conscientiously stated that he could not prove it: (e.g., the 
amous formula for primes, 22” + 1, which Euler later showed breaks down for n=5 since 
641 is then a factor). In discussions of the ‘ Last Theorem ’ it is now customary to distin- 
8uish two cases—a point which Dr. Mordell does not bring out. For Case I’ (which was 
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probably the one Fermat had in mind) it is generally agreed that the theorem is in fact true. 
Yet it is surely a point of interest to the psychologist that almost every mathematical genius 
in every civilized country has attacked the problem, and yet failed to rediscover Fermat's 
** truly remarkable ? proof, or to win the prize of 100,000 marks offered by the Academy at 
Paris for a successful solution. ‘ Case II’ turns out to be still more elusive. E. 
For those who enjoy mathematical puzzles the opening treatise by Felix Klein on 
* Three Famous Problems’ is the most fascinating of all. _Klein succeeds in explaining 
each * problem’ in an exceedingly simple style. To follow his discussion even an acquaint- 
ance with the calculus is unnecessary. The three problems are (i) how to duplicate the 
cube (the ancient Delian problem), (ii) how to trisect an arbitrary angle, and (iii) how to 
square the circle. The last involves the geometrical construction of z. Archimedes 
showed that the ratio of the circumference of a circle to its diameter lies between 34 and 
319. Tsu Chung-Ching (5th century) gave the approximation 3455; which is correct to 
six decimal places: since the fraction —4?/(7?-- 8?) this excellent approximation can be 
effected by Euclidean methods. However, with straight edge and compasses alone (as has 
long been recognized), an exact construction is impossible. Nevertheless, as Klein points 
out, a simple but ingenious instrument, called an * integraph ', has been devised by a 
Russian engineer which will do the trick. 
'The editor's supplementary notes, and the histories of the various issues discussed, 
add still further to the interest of the volume. CYRIL Burt 


Computers and Thought. Edited by E. A. FEIGENBAUM and J. FELDMAN. New York: 
McGraw Hill, 1963. 63s. 


We have all speculated at some time about whether or not machines can be said to be 
intelligent. In the popular view the outward similarity of the behaviour of computers to 
that of humans is taken as evidence of * machine intelligence’. More cautious people have 
been inclined to scoff at the idea, pointing out that machines can do only * what we tell them 
to’. In most applications of computers this is clearly true. A program is prepared for 
the solution of a well-defined problem, with a specific set of instructions for every possible 
eventuality. ‘The human programmer has, or hopes he has, thought of every possible 
path that the program may take. When he loads the program into the computer, we may 
say that he has made a special-purpose machine for the solution of a particular problem. 

On the other hand, there are problems where the number of possible paths is very 
large, and the selection of any one path is heavily dependent upon the current state of the 
machine. It is impossible for the human programmer to consider every possible state in such 
problems. Despite this difficulty some progress has been made in the use of computers in 
this kind of situation: in the recognition of handwritten characters, the proving of geometrical 
theorems and playing chess and draughts. In these cases the machine can be thought of as 

performing processes which the programmer did not build into it. So the possibility exists 


for a machine to exhibit behaviour which could be described as intelligent according to some 
objective test. 


The papers reprinted in the book Computers and Thought represent an important pa't 
of a growing body of work on these problems of machine intelligence by scientists from 
several disciplines. The book is divided into two parts. The first part Suet of papers 
which make no claim to simulate any actual brain mechanisms eae the second part 
contains several papers which throw a new light on such subjects as rote learning anc 
binary choice behaviour. 

The collection begins with an important paper by A. M. Turing. He proposes a proce- 
dure for assessing machine intelligence, in which an interrogator mins By to distinguish 
between a human and a machine by the answers to questions trans; 


ES me mitted by teleprinter: 
This is followed by a very lucid exposition of the mechanistic argument for intelligent 


al 


| 


. 


z 
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behaviour in machines, It is noteworthy that Turing, to whom we owe the theoretical 
foundations of computation, took such a firm Point of View as early as 1950, 
; Qi 


results from those Within a sufficiently Testricted Problem area are impressive for the 
newcomer to this field. The remark of the draughts champion defeated by A, Samuel’s 


The Problem of increasing the generality of problem-solving mechanisms is attacked 
by Newell, Shaw and Simon in the General Problem Solver, Which is an algorithm for 
Benerating and seeking Sub-goals in a general problem environment, But there are many 
aspects of human problem-solving behaviour besides Soal-seeking which require greater 
formalization before they can be included in a mechanical model. Not least is the ability to 
form concepts and this may well be the crucial Problem in the Study of machine intelligence. 

The editors, who are Psychologists, have Produced a collection of papers admirably 
balanced between the empirical approach to machine intelligence and the Contribution of 
“the Study of computers to the theoretical understanding of human behaviour, The intro- 


without these details, The contributions were originally published in a widespread section 
of journals and Proceedings, and in many cases the authors have brought their Papers up to 
date for this book. There is an exhaustive bibliography which will be Invaluable to workers 
in the field, Anyone who js at all curious about machine intelligence should read this book, 


GEORGE F, CovLounrs 


Handbook of Mathematica] Psychology, Vol. I. Edited by R. D, Luce R. R. Busu 
and E, GALANTER, New York and London: Wiley, 1963. Pp. Xii +491, 80s. 
Readings in Mathematical Psychology, Vol. I. R, D. Lucr, R. R. Busu and E. 

GaLaNTER, New York and London: Wiley, 1963, Pp.535. 68; 


E.G: Boring once remarked that “ the work of the mathematicophiles may Perhaps be 
explained by the fact that the elaborate and arduous mathematical method distracts attention 


easy to find Psychologists who regard this comment as apt. On the other hand, it must be 
admitte, that the * mathematicophiles ' now make up a larger Proportion of Psychologists 
than hitherto and they cannot be dismissed quite so summarily, Indeed, there has been 
an almost explosive Erowth in the number of psychological Papers relying on mathematically 
formulated arguments. The mathematicophiles are multiplying, d 
But to what effect? Is it now necessary to Provide a good background in mathematics 


answers to questions of this kind. [t is the first in a series consisting of three handbooks 
of mathematical Psychology anq two accompanying volumes of selected readings, the latter 


© editors have been giving courses on mathematical approaches to Psychological 
Problems at the University of Pennsylvania for several years. Their Original Intention 
was to put the relevant research material into 4 single volume which would be suitable asa 
textbook for undergraduate and graduate courses, However, the contributions of their 
authors Were such as to lead to the undertaking of the present more ambitious enterprise, 
The first volume, reviewed here, is Concerned mainly with measurement and Psychophysics, 
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hi nd, which has also appeared, is devoted to mathematically formulated theories or 
qus uod E social behaviour. The last, we are told, is a more miscellaneous work an 
RE Mun senses, learning, preference and mathematics per se. The first volume of 
the ancillary readings covers measurement, psychophysics and learning, and “a oe 
d stimulating collection of reprints. The remaining topics will be covered in e second 
d There remain several areas of psychology where mathematics has flourished 
b crat not discussed in the present series, In three instances this was intentional: 
" das er theory, scaling and factor analysis were considered to have been fully described 
pem c On the other hand, the theory of mental tests was not covered because = 
editors did not manage to find a willing author. One cannot but regret this omission. t 
is an area in which there are many technical complexities and an authoritative essay on 
approaches now current would have been extremely welcome. 

‘As far as the first volume is concerned, the mathematical demands on the reader are not 
very great. Given an intention to understand the arguments, a point somewhere on the 
road from * O ’ to ‘A’ level school mathematics should be an adequate mathematical prepara- 
tion. However, several of the chapters, particularly Six and Eight, do presuppose a con- 
siderable knowledge of probability theory and mathematical statistics. But the greatest 
obstacle to understanding for the average ‘ mathematicophile ’ is likely to be an absence 
of sufficient knowledge of logic to cope with the first chapter and a related unfamiliarity 
with the kinds of detailed axiomatic statements of mathematical notions which occur from 
time to time throughout the book. The latter, however, do not present an insurmountable 
problem and the reader is often given considerable guidance by the authors. However, 


although the first chapter may be read, so to speak, between the axioms, a proper understand- 
ing of it does demand some facility in formal logic. 


: In the reviewer's opinion the Hand- 
book is best approached by means of a small seminar in which various mathematical and 


statistical intuitions are represented: a logician may be useful. 

The above comments are not meant to be adverse to the substance of the opening 
chapter by Suppes and Zinnes on ‘Measurement Theory’: the ideas it contains are expressed 
in a clear and unambiguous way. The authors approach their topic by formulating two 


fundamental problems: (1) the justification of i 
do; the assignment m a 
phenomena; (2) the specification of the extent to which tl Bf mithes- te objects ar 


first problem is dealt with by precisely characte: 


operations used in a measurement proced i 

s ure and showing that th i i 

E € ure: ey are isom aps 

homomorphic) to the operations and relation in an appropriately s Bie irm ri s 
o $ 


* Isomorphic ' here refers t 
2n 0 a one-to-one corre: 
a total empirical system of measured objects and th spondence between, on the one hand, 


: e relations amon ts 
ee ns E elements and relations which characterize ds tod descripti 
" e less stringent homomorphic c cted desc 
i j i i orrespondence bet irical 
and numerical systems is mentioned because there arise cases wher ween the ces pw 
same measurement value assigned to them. The appr h € two objects have 
‘measurement’ synonymous with ‘theory’, but p oach may seem so broad as to make 
: : » but the authors stress t int that the 
Mee ree qe only likely to be of value when the Sofa ec 
v cde e an amiliar relations. They attach no particular Mim the operation 
Neither do th iin s beri have considered essential to the ‘action of measurement. 
1 e 
D ids ud. Orin yiconsl m o the Carrying out of certain empirical operations on the measured 
d m ed. p spei ic on be satisfied before measurement b a id f been 
achieved. The whole emphasis is placed upo panine Said Xo Dave 
"e E n the corres ; in the 
empirical system of objects to those in the system of pondence de the retarioris ei le 
measurement. numbers representing the scale 
'The question of the uniquenes 
S of the numeri ian 
E deer . ical syst i ; n is 
answer P ystem used in situatio 
: : (ie d penes nin eser. d Systems which could be pedit use 
E 3 ects. € particular ki i n 
determ ;€ particular kind of measurement scale is the 
ined by the nature of the transformations which map any of the alternative scales ©” 


w his assignment is unique. The 
tizing the formal properties of empirical 
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to o; : - E i j 
ne another. Thus for so-called interval scales ifs measures an object on one scale 


and Y measures it on another then it will be found that Y—a-bx for all objects Hence 


Which object ; is Preferred to object j, Pj, is expressed in the form Pih; s. The 
7 s are derived measures of preference for the various objects, i 

. Although the formal analysis of measurement is both thorough and intellectually 
stimulating, the chapter lacks, apart from one or two illuminating asides, any adënnate 
discussion of the measurement problem in relation to actual psychological observations. 


stance requires the same response as would usually be given in the absence of stimulation. 
On the other hand, the experimenter may be heavily rewarding all detections and this 
outcome may determine the subject to report the presence of a stimulus since this may 
maximize his expected gain or optimize his performance in some other way. Like all 
classification schemes this one reveals some kind of experiments which have not yet been 
conducted and someone might be tempted to investigate them, 

The third chapter, on ‘ Detection and Recogniti 
Handbook, It is mainly about Situations in which 
Several kinds of stimulation and has to decide which it was. 


xperimental task cannot regard the 


Subject's performance as a direct function of his sensitivity alone. It is also necessary to 


indicate how his performance will be affected by motivation; for example, by the rewards 


ind punishments contingent upon correct detections and false alarms. Of the three 
ignal detectability model in which the sub- 


the present stimulation according to the 


alternative hypotheses of the source being ‘noise’ and ‘ noise plus a signal A taking the 
ratio of these, and announcing the Presence of a signal when this ratio exceeds some criterial 
value, Here Sensitivity is measured by the estimable distance between the means of the 
likelihood ratio distributions resulting from the two alternatives, Performance varies by 
an adjustment to the Position of the Criterion on the likelihood ratio axis. Luce then 
Considers an extension of his treatment of detection in terms of the choice model which was 
the Subject of his monograph ‘ Individual Choice Behaviour’. In this scheme, sensitivity 

between the two sources of 
stimulation, and performance may be modified by a bias in favour of making one or other 
of the responses. Finally, a threshold model of detection is presented. However, Luce 


Probability that the threshold will be exceeded when no signal is present. The subject 
May stil] adjust his performance: by falsely reporting that he detected a signal on trials 
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on which the threshold was not exceeded, or falsely denying detection when it was exceeded. 
One result of this generalization is that the theory can now be used to describe satisfactorily 
certain gross features of the function relating the probability of detecting signals to the 
probability of falsely designating noise as a signal (the ROC curve). 

Luce shows how the schemes fare in a variety of situations and altogether the chapter 
is a very good guide through the problems of this area of psychophysics. On the experi- 
mental side, he is perhaps not sufficiently critical of his own theory. In particular, little 
is said about the use of a rating technique in detection experiments which suggests that 
subjects can order sensory input even at the low intensity levels which would correspond to 
the threshold of traditional theories. This is a finding which would seem to be hard to 
represent within the structure of a theory which is stated in terms of responses biases. 

Chapter Four is on * Discrimination’ and was written by Luce and Galanter. It is 
concerned mainly with discriminability scales: Fechner's original psychophysical law; 
'l'hurstone's ‘law of comparative judgement ^; and the Bradley-Terry-Luce scale for 
representing paired comparison data. In all cases these are derived measurements based 
on the notion that confusion between stimuli may be used to scale the psychological distance 
between them. The emphasis on scaling in this chapter will make it of less interest to most 
psychologists than the one on detection. The authors claim that there are relatively few 
data that are suitable to test existing mathematical theories in this area of psychophysics. 
Itmay well be that the authors are considering the wrong kinds of theories of discrimination. 
If we still do not have any useful account of different ways in which stimulus patterns can 
be discriminated, then a useful chapter would have been one giving a careful mathematical 
analysis of the most common psychophysical techniques used in the study of discrimination. 

'The same authors make a general survey of most other kinds of psychophysical scales 
in Chapter Five. 'This is much more interesting than the treatment of discriminability 
scaling because here they attempt to consider the kinds of operations which the different 
scaling techniques would seem to demand from a subject. In particular there is a very 
careful analysis of some of the issues raised by the magnitude estimation method championed 
by Stevens. ‘here are clear indications of an interaction between the original views of 
the authors and Steven's critical comments on an earlier draft of the chapter. A very 
spirited attempt is made to determine the extent to which any true psycho-physical function 
relating stimulus to psychological magnitude can be separated from responses biases and 
motivational variables operating in the typical laboratory experiment. It is certain that 
in the debate which will undoubtedly continue about the ‘ power law’ the pages of this 
chapter will be often thumbed. 

. Chapter Six on * Stochastic Latency Mechanism’ by McGill is regarded by the 
reviewer as something of a tour de force. It is a systematic examination of various systems 
which could be postulated to account for the delay between the presentation of a stimulus 
and the ensuing response. General techniques for obtaining the characteristics of such 
systems are first clearly outlined. "Then starting from the simplest model of waiting 
times—the Poisson process which leads to an exponential distribution of response latencies 
—successive complications are studied; adding further independent processes to the chain 
of events filling the stimulus-response interval; making the response the first to occur in 
several similar parallel systems; and so on. Although the chapter would have been even 
better if it had provided a systematic analysis of temporal aspects of choice McGill does 
indicate how this could be contrived. Indeed, there are a host of ihearetioal ideas in the 
modest and lucid commentary which accompanies the mathematical formulae. Ilustra- 
tions of the various schemes are nicely selected from a wide range of ex: erimental results 
and there can be few psychologists using response time as a datum who m not find this 2 
ual chapter. It is to be hoped that this essay may be the sketch plan for a 

ook. 

Newell and Simon contribute the next chapter on ‘Computers in Psychology ^ 
Unlike the others which are introductions to the actual mathematical techniques used in 


LES 
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particular topics, this one is confined, almost unavoidably, to a Survey of what has and might 
be done in the way of computer simulations of behaviour, Although written by aE hee 
computer enthusiasts it gives a very sober appraisal of the problems of comparing computer 
simulations with real behaviour. In the context of the Handbook, With its over-all emphasis 


psychological phenomena is that it is not usually possible to make general inferences about 
the performance of such systems and it becomes difficult to test them empirically, ‘The 
clear discussion of problems of this kind and the variety of simulations presented in this 
chapter make it an excellent aperitif to the computer literature, 

‘The last chapter by Bush is a short one, ‘ Estimation and Evaluation’. ‘The problems 
of the first process are well understood and a simple illustrated account of the various 
available procedures is provided. The evaluation of models is only lightly touched upon 
and is perhaps too closely linked with an accurate representation of the experimental data 
from any given situation. Even when writing of the virtues of an hypothesis which covers 
several different situations, Bush places emphasis upon parameter invariance, There 
must, surely, often be Srosser features of a model which argue for or against its acceptance 
and make it unnecessary to go into the details of testing for the stability of parameters across 
Various situations, 

In conclusion it can be said this volume clearly demonstrates that mathematics can be 
usefully employed in the analysis of a wide range of psychological problems and at the 
same time it provides a useful illustrated guide to some areas where this analysis has been 
most thoroughly conducted. Excepting the chapter on computer simulation, that by 
McGill on latency mechanisms and part of Luce's chapter on detection, it could nevertheless 
be argued that too much emphasis is placed upon a rather formal description of experi- 
mental situations, The approach to a problem is often made from a mathematician’s point 
of view and we are not always given a mathematical analysis of plausible psychological 
hypotheses, The title of Handbook is not entirely appropriate; it is probably too early 
for any work to achieve that status, and this one retains the flavour of the introductory 
textbook which the editors originally had in mind. But an introductory textbook of mathe- 
matical psychology was sorely needed and the editors and authors are to be congratulated 
on their achievement. The reviewer expects that many, like himself, will want to use 


this work as the basis for postgraduate seminars for some time to come. 
R. J. AupLEY 


The Logic of Preference. By G. H. von Wnicnr. Edinburgh: The University Press, 
1963. Pp.68. 10s. 6d. 


This short study is an expanded version of lectures given in the University of 
Edinburgh in 1962. The author is not concerned with utility or “ measurable value 
Nor with probability. He acknowledges Ramsay’s influential essay ‘Truth and 
Probability * (1931) and Halldén’s * Or the Logic of Better’ (1957), but takes a slightly 

Itferent Standpoint. His object is to study preference from a formal logical point of view, 
9n the grounds that preference can, as logically prior, be studied independently of 
Utility anq probability. He comments that "authors on these topics usually take for 
Stanted certain logical features of Preferences—such as asymmetry and transitivity—and 
then hasten on to utility (and/or probability) . . . the temptation is worth resisting for the 
Sake of first Creating a systematic formal theory of preference ". 
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à umed to be familiar with elementary propositional calculus. Using P 
Beige bis d r as primitives, von Wright—after limiting himself to 
utr rid ren HE us de d making the "distinction generally accepted between 
preference in a single instance, and m: g denos dérenuinant of behaviout 
choice as observable behaviour and preference as an underlying det l ) A 
— obtains a number of conclusions pertinent to preference not involving risk. In his 
system pg is “ tantamount " to saying (p.-—q)P(—p.q) where ipie pe 
consequent of this latter relation are taken to be contemplated possib. e changes "i m 
subject's present condition. By considering preferences among the triples. b, q and r he 
obtains a distinction between conditional and unconditional preferences; this raises difficulties 
at the intuitive psychological level which are circumvented by postulating a universe of 
discourse which is the set of all variables p, q, r . . . and then ‘ embedding’ preferences in 
this universe, to reflect what von Wright calls the ‘ ceteris paribus’ quality of preferences. 
Examining permissible transformations of P-expressions, von Wright identifies P-tautologies 
and shows that what is an equivalence in propositional logic may not be so in P-logic. He 
states “ expressions which are probably equivalent in the logic of propositions are not, 
without restriction, intersubstitutable in expressions of the logic of Preference. The 
restriction is that the substitution must not introduce new variables into the atomic P- 
expression in which the substitution takes place." 
The other major point of interest to psychologists is that von Wright is obliged to 
distinguish between J (indifference) and E (equivalence), so that value-equality is stronger 


than indifference; states which are value-equal are necessarily indifferent; but states which 
are indifferent between themselves are not necessarily value-equal. 'l'his is shown to 
follow from his definitions of / and E. 

; Miller (Mathematics and Psychology, 1964) has recently pointed out that a shift 
historically in psychologists’ attitudes to normative theory has taken place; such theories 
are now acceptable as reference models against which to compare actual behaviour, even 
when they are known to be in some degree false. Formerly they tended to be out of 
favour, which in part accounts for the difference in de 
logical theories of choice behaviour. Von Wright does 
be used as a normative theory of behaviour, 
(e.g. * anthropological ’ when he means ‘ psy 
feels his theory is fundamental to economic, 
describe economic choice. 


t Th ose concerned 
5 ystems. e reviewer feels it ma: i 
relevant to the comparative analysis of aesthetic cho y be directly 


ice b i : 2 H 

vant alternatives present, but again there is evidence eripe ig E without Hie 
readily described by the proposed system. preferences are no 

Von Wright's difficulties with indifference and tr: 
faced by previous writers such as Luce or Arrow, wi 
models from preference-utility-probability axioms, and much remai be done if his 
book is to become the basis of experimental research, The book i rn to | : Gne ben a 
earlier analysis of modal logic, but it may be read wi is less satisfying 
von Neumann and Morgenstern too much to swallow. R. A. M. GREGSON 
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